-- Logs begin at Tue 2022-07-26 09:39:46 UTC, end at Tue 2022-07-26 10:39:52 UTC. -- Jul 26 10:12:26.343982 dv-osbrick-850937-2-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 26 10:12:26.352507 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 26 10:12:26.355189 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 10:12:26 2022] *** Jul 26 10:12:26.355344 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 10:12:26.355452 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 10:12:26.355554 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: nodename: dv-osbrick-850937-2-ceph Jul 26 10:12:26.355656 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: machine: x86_64 Jul 26 10:12:26.355764 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: clock source: unix Jul 26 10:12:26.355764 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: pcre jit disabled Jul 26 10:12:26.355764 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: detected number of CPU cores: 4 Jul 26 10:12:26.355764 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: current working directory: / Jul 26 10:12:26.355764 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: detected binary path: /usr/bin/uwsgi-core Jul 26 10:12:26.355764 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: your processes number limit is 47680 Jul 26 10:12:26.355764 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: your memory page size is 4096 bytes Jul 26 10:12:26.355764 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: detected max file descriptor number: 2048 Jul 26 10:12:26.355764 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: lock engine: pthread robust mutexes Jul 26 10:12:26.356266 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: thunder lock: enabled Jul 26 10:12:26.356266 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 26 10:12:26.356266 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 10:12:26.399748 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: Python main interpreter initialized at 0x5572d32d39c0 Jul 26 10:12:26.399748 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: python threads support enabled Jul 26 10:12:26.399748 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: your server socket listen backlog is limited to 100 connections Jul 26 10:12:26.399748 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: your mercy for graceful operations on workers is 90 seconds Jul 26 10:12:26.400158 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 10:12:26.400158 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: *** Operational MODE: preforking *** Jul 26 10:12:26.400434 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: *** uWSGI is running in multiple interpreter mode *** Jul 26 10:12:26.400434 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: spawned uWSGI master process (pid: 87115) Jul 26 10:12:26.400652 dv-osbrick-850937-2-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 26 10:12:26.401674 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: spawned uWSGI worker 1 (pid: 87124, cores: 1) Jul 26 10:12:26.401674 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: spawned uWSGI worker 2 (pid: 87125, cores: 1) Jul 26 10:12:26.401820 dv-osbrick-850937-2-ceph devstack@keystone.service[87115]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 10:12:32.125314 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 10:12:32.125314 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: from cryptography.utils import int_from_bytes Jul 26 10:12:32.126307 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 10:12:32.126307 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: from cryptography.utils import int_from_bytes Jul 26 10:12:32.126307 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 10:12:32.126307 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: from cryptography.utils import int_from_bytes Jul 26 10:12:32.126889 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 10:12:32.126889 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: from cryptography.utils import int_from_bytes Jul 26 10:12:32.176883 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 10:12:32.177105 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 10:12:32.177181 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 10:12:32.177280 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 10:12:32.177342 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] command line args: [] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 10:12:32.177405 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] command line args: [] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 10:12:32.177467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 10:12:32.177524 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 10:12:32.177677 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ================================================================================ {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 10:12:32.177760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ================================================================================ {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 10:12:32.177872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] admin_token = **** {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.177948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] admin_token = **** {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.178123 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] config_dir = [] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.178220 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] config_dir = [] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.178285 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.178366 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.178492 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] config_source = [] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.178584 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] config_source = [] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.178717 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] debug = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.178862 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] debug = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.178862 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.179189 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.179285 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.179363 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.179474 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.179563 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.179624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.179703 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.179995 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.180081 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.180081 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] list_limit = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.180196 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] list_limit = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.180259 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] log_config_append = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.180342 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] log_config_append = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.180404 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.180465 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.180617 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] log_dir = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.180699 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] log_dir = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.180759 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] log_file = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.180815 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] log_file = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.180999 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.181115 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.181203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.181280 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.181432 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.181512 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.181680 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.181769 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.181843 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.181914 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.182009 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.182153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.182235 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.182309 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.182502 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.182683 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.182872 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.183036 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.183209 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.183357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.183527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.183697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.183868 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.184033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.184175 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.184352 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.184517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.184677 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.184811 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.184985 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.185152 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.185326 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.185492 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] publish_errors = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.185666 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] publish_errors = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.185811 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.185986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.185986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.186256 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.186369 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.186539 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.186655 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.186932 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.186932 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.187176 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.187349 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] standard_threads = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.187467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] standard_threads = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.187619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.187735 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.187855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.187976 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.188091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.188215 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.188336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] use_journal = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.188456 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] use_journal = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.188568 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] use_json = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.188687 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] use_json = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.188800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] use_stderr = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.188948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] use_stderr = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.189062 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] use_syslog = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.189181 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] use_syslog = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.189293 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.189412 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:12:32.189532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.189644 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.189756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.189867 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.189978 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.190082 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.190179 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.190279 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.190375 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.190499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.190600 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.190714 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.190813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.190906 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.191000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.191099 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.191196 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.191297 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.191401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.191500 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.191648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.191763 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.191882 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.192002 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.192121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.192241 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.192354 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.192465 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.192582 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.192771 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.192887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.193005 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.193117 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.193228 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.193341 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.193460 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.193572 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.193683 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.193801 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.193913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.194031 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.194151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.194264 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.194375 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.194517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.194632 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.194750 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.194855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.194951 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.195044 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.195137 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.195248 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.195360 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.195481 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.195595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.195713 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.195824 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.195935 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.196054 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.196178 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.196302 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.196421 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.196539 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.196651 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.196816 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.196932 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.197044 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.197155 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.197272 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.197383 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.197510 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.197623 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.197735 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.197853 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.197965 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.198076 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.198270 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.198385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.198582 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.198695 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.198806 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.198928 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.199050 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.199163 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.199274 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.199384 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.199495 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.199607 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.199730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.199844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.199955 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.200066 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.200177 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.200272 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.200373 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.200492 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.200604 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.200722 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.200834 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.200951 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.201055 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.201167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.201278 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.201388 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.201506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.201648 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.201774 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.201887 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.201999 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.202117 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.202229 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.202341 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.202480 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.202597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.202709 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.202822 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.202934 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.203052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.203172 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.203294 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.203407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.203528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.203648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.203761 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.203874 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.204131 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.204313 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.204504 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.204641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.204763 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.204878 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.204990 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.205111 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.205225 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.205337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.205455 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.205568 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.205689 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.205803 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.205917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.206028 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.206146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.206259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.206383 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.206526 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.206639 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.206751 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.206901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.207032 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.207032 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.207262 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.207374 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.207485 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.207596 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.207707 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.207826 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.207939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.208052 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.208171 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.208284 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.208284 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.208502 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.208615 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.208727 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.208727 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.208943 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.209057 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.209177 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.209296 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.209413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.209532 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.209645 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.209756 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.209949 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.210072 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.210193 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.210306 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.210424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.210608 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.210733 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.210857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.210981 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.211095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.211207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.211318 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.211430 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.211541 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.211661 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.211774 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.211886 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.211998 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.212110 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.212222 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.212343 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.212465 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.212578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.212690 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.212802 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.212913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.213033 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.213147 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.213260 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.213372 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.213489 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.213610 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.213724 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.213724 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] auth.external = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.213933 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.214045 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.214156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.214156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] auth.external = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.214377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.214507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.214652 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.214652 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] auth.password = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.214876 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.214989 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] auth.token = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.215101 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.215221 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.215336 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] auth.password = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.215456 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.215571 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] auth.token = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.215683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.215796 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.215916 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.216030 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.216143 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.216256 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.216398 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.216529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.216654 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.216774 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.216888 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] credential.caching = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.217002 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.217114 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.217233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.217354 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.217476 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] credential.caching = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.217590 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.217703 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.217815 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.217927 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.218048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.218162 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.218275 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.218387 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.218545 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.218659 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.218784 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.218900 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.219012 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.219132 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.219246 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.219359 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.219480 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.219604 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.219718 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.219831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.219943 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.220057 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.220181 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.220303 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.220418 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.220418 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] federation.caching = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.220631 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.220743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.220863 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.220978 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.221090 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.221210 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.221324 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] federation.caching = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.221436 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.221557 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.221672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.221786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.221898 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.222010 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.222122 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.222244 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.222358 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.222497 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.222614 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.222729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.222841 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.222972 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.223087 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.223200 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.223313 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity.caching = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.223425 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.223538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.223734 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.223851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.223965 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.224078 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.224191 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity.caching = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.224312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.224426 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.224540 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.224652 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.224767 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.224879 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.225007 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.225122 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.225235 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.225338 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.225449 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.225561 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.225681 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.225796 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.225909 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.226022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.226135 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.226247 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.226368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.226642 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.226776 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.226892 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.227006 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.227119 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.227240 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.227355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.227469 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.227582 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.227694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.227806 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.227928 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.228043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.228156 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.228275 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.228395 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.228509 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.228629 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.228744 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.228857 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.228971 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.229083 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.229196 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.229316 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.229431 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.229544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.229657 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.229769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.229882 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.230014 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.230129 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.230242 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.230355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.230481 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.230596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.230723 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.230838 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.230951 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.231065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.231177 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.231290 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.231411 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.231524 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.231637 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.231750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.231862 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.231862 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.232084 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.232199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.232312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.232312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.232312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.232621 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.232742 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.232856 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.232968 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.233081 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.233195 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.233307 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.233427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.233541 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.233654 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.233766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.233878 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.233990 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.234111 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.234226 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.234348 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.234550 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.234666 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.234779 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.234903 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.235017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.235131 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.235331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.235453 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.235566 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.235688 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.235802 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.235915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.236034 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.236148 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.236268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.236384 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.236497 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.236610 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.236722 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.236845 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.236967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.237081 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.237194 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.237194 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.237407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.237520 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.237640 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.237754 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.237866 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.237979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.238092 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.238210 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.238333 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.238467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.238583 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.238696 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.238808 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.238808 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.239031 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.239147 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.239259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.239372 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.239485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.239485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.239703 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.239817 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.239930 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.240043 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.240155 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.240268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.240380 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.240494 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.240607 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.240719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.240831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.240943 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.241063 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.241177 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.241290 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.241402 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.241513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.241513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.241733 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.241733 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.241946 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.242058 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.242170 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.242282 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.242402 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.242561 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.242676 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.242789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.242901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.243014 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.243138 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.243254 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.243367 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.243479 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.243592 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.243705 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.243826 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.243941 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] resource.caching = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.244053 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.244165 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.244278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.244390 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.244510 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.244623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.244737 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] resource.caching = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.244850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.244961 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.245073 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.245194 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.245308 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.245420 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.245533 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.245646 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.245759 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.245941 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.246055 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.246168 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.246280 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] role.caching = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.246393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.246525 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] role.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.246652 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.246767 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.246884 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.247004 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.247118 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] role.caching = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.247231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.247352 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] role.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.247473 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.247593 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.247708 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.247821 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.247933 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.248054 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.248169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.248281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.248394 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.248507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.248628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.248743 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.248857 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.248969 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.249082 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.249201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.249323 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.249437 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.249550 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.249662 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.249774 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.249887 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.249887 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.250110 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.250223 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.250335 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.250470 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.250586 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.250586 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.250814 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.250927 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.251040 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.251152 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.251264 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.251385 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.251500 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.251612 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.251724 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.251837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.251949 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.252071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.252185 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.252298 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.252410 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.252523 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.252636 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.252764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.252879 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.252992 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.253105 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.253218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.253338 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.253452 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.253565 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.253677 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.253790 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.253902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.254023 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.254139 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.254139 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] token.caching = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.254350 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.254529 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.254646 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.254646 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.254871 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.254984 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.255097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.255211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] token.caching = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.255324 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.255445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.255559 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.255673 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.255785 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.255897 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.256009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.256130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.256246 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.256246 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.256456 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.256569 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.256681 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.256805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.256920 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.257032 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.257145 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.257258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.257377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.257498 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.257613 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.257725 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.257837 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.257950 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.258062 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.258182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.258297 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.258297 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.258522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.connection = **** {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.258649 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.258772 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.258886 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.258998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.258998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.259219 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.259331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.259444 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.connection = **** {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.259565 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.259688 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.259801 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.259921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.260035 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.260147 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.260259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.260372 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.260476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.260595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.260710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.260821 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.260933 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.261046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.261158 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.261261 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.261332 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.261397 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.261471 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.261542 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.261613 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.261691 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.261764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.261834 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.261905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.261964 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.262023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.262023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 10:12:32.262155 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.262155 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.262155 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.262155 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.262155 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:12:32.262155 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 10:12:32.289570 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.289774 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.289890 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.290465 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.290683 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.290926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.299053 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.299927 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.329746 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.329982 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.330066 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.330273 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.384672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.385171 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.435841 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.436061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.437315 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.437549 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.500445 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.500640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.500783 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.500867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.500935 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.501099 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.501224 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.501314 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.501392 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.501461 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.501532 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.501737 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.524938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.525106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.525190 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.525266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.525334 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.525405 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.525543 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.525638 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.525809 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.525898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.525967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.526054 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.526160 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.526242 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.537275 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.537872 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.550687 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.550831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.551048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.551175 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.551252 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.551339 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.551416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.551478 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.551660 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.551787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.551864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.551954 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.552030 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.552260 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:12:32.568676 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.568864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 10:12:32.569194 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.569320 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.569397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 10:12:32.569472 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 10:12:32.569699 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.569824 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.569916 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 10:12:32.569994 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.570134 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.570260 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.570370 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.570502 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.570681 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.570954 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.580487 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.580625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.580717 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.580876 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.580961 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.581202 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.581289 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.581476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.590174 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.590341 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.593146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.593240 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.593440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.593550 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.593706 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.593794 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.593982 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.594069 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.594259 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.594352 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.594561 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.594643 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.594850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.594933 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.595102 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.595186 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.595370 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.595454 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.595640 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.595741 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.595905 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.595990 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.618655 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.618794 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.620120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.620268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.620349 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.620424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.624967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.625096 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.625194 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.625271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.625496 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.625620 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.632163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.632308 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.632424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.632514 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.636545 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.636766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.636882 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.637003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.637093 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.637316 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.637441 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.637598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.637737 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.637992 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.638118 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.638239 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.638333 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.638564 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.638687 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.638803 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.654207 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.654414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.654557 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.654637 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.658381 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.658575 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.661505 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.661710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.661826 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.661989 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.666225 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.666355 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.669728 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.669877 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.672884 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.673011 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.673173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.673300 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.673398 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.673476 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.673705 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.673832 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.674074 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.674215 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.674330 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.674420 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.690103 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.690231 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.690354 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.690474 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.690666 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.690792 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.690892 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.691078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.697700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.697870 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.699388 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.699515 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.699711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.699852 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.702313 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.702463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.702620 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.702747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.702881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.703031 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.703183 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.703323 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.703427 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.703531 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.714736 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.714883 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.714955 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.715119 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.715259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.715330 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.715524 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.715651 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.715801 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.715943 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.716013 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.716134 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.716319 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.716445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.731869 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.732138 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.734906 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.735492 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.738986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.740454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.740696 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.741957 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.742085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.742210 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.742519 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.743735 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.744014 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.744282 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.858754 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.859107 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.860202 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.860685 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.863183 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.863459 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.863686 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.863828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.863979 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.864121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.864200 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.864323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.871843 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.872118 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.872208 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.872400 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.872486 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.872739 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.879238 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.879559 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:12:32.879643 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.879888 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.879970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.880160 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.880269 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.880427 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.880513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.880709 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.880801 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.880979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.881070 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.881241 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.881333 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.881514 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.881596 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.881773 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.881855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.882040 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.882129 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.882291 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.882373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.882572 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.882654 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.882826 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.882920 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.883078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:12:32.915771 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5572d32d39c0 pid: 87125 (default app) Jul 26 10:12:32.916061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5572d32d39c0 pid: 87124 (default app) Jul 26 10:12:32.919856 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044db237-3f16-445a-8761-9165939512b4 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:32.920140 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044db237-3f16-445a-8761-9165939512b4 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:32.920413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044db237-3f16-445a-8761-9165939512b4 None None] PATH_INFO: `/v3` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:32.924855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Tue Jul 26 10:12:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:41.082458 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b58c8-2198-4611-a1ed-e4a1e1a821fd None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:41.083066 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b58c8-2198-4611-a1ed-e4a1e1a821fd None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:41.083066 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b58c8-2198-4611-a1ed-e4a1e1a821fd None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:41.087389 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:12:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:41.093799 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936e12a-6282-4e35-86ca-1d2c5992eeba None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:41.094631 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936e12a-6282-4e35-86ca-1d2c5992eeba None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:41.094631 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936e12a-6282-4e35-86ca-1d2c5992eeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:41.182671 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: INFO dbcounter [None req-f936e12a-6282-4e35-86ca-1d2c5992eeba None None] Registered counter for database keystone Jul 26 10:12:41.206339 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG oslo_db.sqlalchemy.engines [None req-f936e12a-6282-4e35-86ca-1d2c5992eeba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 10:12:41.217156 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writer thread running {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 10:12:41.414052 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG passlib.handlers.bcrypt [None req-f936e12a-6282-4e35-86ca-1d2c5992eeba None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87125) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 10:12:41.414468 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG passlib.handlers.bcrypt [None req-f936e12a-6282-4e35-86ca-1d2c5992eeba None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87125) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 10:12:41.471904 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-f936e12a-6282-4e35-86ca-1d2c5992eeba None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:41.473565 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-f936e12a-6282-4e35-86ca-1d2c5992eeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:41.613439 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 521 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 26 10:12:41.772708 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b58c8-2198-4611-a1ed-e4a1e1a821fd None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:41.851709 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: INFO dbcounter [None req-753b58c8-2198-4611-a1ed-e4a1e1a821fd None None] Registered counter for database keystone Jul 26 10:12:41.873535 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG oslo_db.sqlalchemy.engines [None req-753b58c8-2198-4611-a1ed-e4a1e1a821fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 10:12:41.881576 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writer thread running {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 10:12:42.000818 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b58c8-2198-4611-a1ed-e4a1e1a821fd None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:42.006234 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc9db6-6373-422a-9c31-f3a819f69b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:42.006902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc9db6-6373-422a-9c31-f3a819f69b4c admin admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:42.007183 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc9db6-6373-422a-9c31-f3a819f69b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:42.007457 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc9db6-6373-422a-9c31-f3a819f69b4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:42.017276 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc9db6-6373-422a-9c31-f3a819f69b4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:42.069106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a7fc9db6-6373-422a-9c31-f3a819f69b4c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 10:12:42.069390 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc9db6-6373-422a-9c31-f3a819f69b4c admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:42.080335 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Jul 26 10:12:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 10:12:42.087623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936e12a-6282-4e35-86ca-1d2c5992eeba None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:42.111478 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936e12a-6282-4e35-86ca-1d2c5992eeba None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:42.117159 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136b323-d486-4c52-b6e8-441dd2365141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:42.118310 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136b323-d486-4c52-b6e8-441dd2365141 admin admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:42.118630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136b323-d486-4c52-b6e8-441dd2365141 admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:42.118908 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136b323-d486-4c52-b6e8-441dd2365141 admin admin] PATH_INFO: `/v3/projects/a699385ce385472fabea3d65e4ca80c6` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:42.120532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136b323-d486-4c52-b6e8-441dd2365141 admin admin] RBAC: Authorizing `identity:get_project(project_id=a699385ce385472fabea3d65e4ca80c6)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:42.171377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d136b323-d486-4c52-b6e8-441dd2365141 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 10:12:42.171717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136b323-d486-4c52-b6e8-441dd2365141 admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:42.176548 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Jul 26 10:12:42 2022] GET /identity/v3/projects/a699385ce385472fabea3d65e4ca80c6 => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:44.365034 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dcdbe-725b-473c-9189-df03eaa6fd0b None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:44.365864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dcdbe-725b-473c-9189-df03eaa6fd0b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:44.365864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dcdbe-725b-473c-9189-df03eaa6fd0b None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:44.372557 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:12:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:44.381237 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36e5a0-e104-4b01-bd7e-66f32438f3ff None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:44.381690 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36e5a0-e104-4b01-bd7e-66f32438f3ff None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:44.381788 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36e5a0-e104-4b01-bd7e-66f32438f3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:44.402864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-7b36e5a0-e104-4b01-bd7e-66f32438f3ff None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:44.404391 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-7b36e5a0-e104-4b01-bd7e-66f32438f3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:44.412911 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 26 10:12:44.436684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2dcdbe-725b-473c-9189-df03eaa6fd0b None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:44.457582 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2dcdbe-725b-473c-9189-df03eaa6fd0b None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:44.463014 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e8853-a8cb-483f-a62a-3006dec79f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:44.463656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8853-a8cb-483f-a62a-3006dec79f10 admin admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:44.463939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8853-a8cb-483f-a62a-3006dec79f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:44.464215 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8853-a8cb-483f-a62a-3006dec79f10 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:44.472783 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e8853-a8cb-483f-a62a-3006dec79f10 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:44.474668 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e8853-a8cb-483f-a62a-3006dec79f10 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:44.483983 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Jul 26 10:12:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 10:12:44.490653 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36e5a0-e104-4b01-bd7e-66f32438f3ff None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:44.504898 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36e5a0-e104-4b01-bd7e-66f32438f3ff None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:44.512299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae6b68-7a08-4857-ab75-d5946060d0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:44.513257 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae6b68-7a08-4857-ab75-d5946060d0bf admin admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:44.513644 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae6b68-7a08-4857-ab75-d5946060d0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:44.513991 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae6b68-7a08-4857-ab75-d5946060d0bf admin admin] PATH_INFO: `/v3/users/a7aff02dbe9d4c34ad6d286018218135` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:44.516311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae6b68-7a08-4857-ab75-d5946060d0bf admin admin] RBAC: Authorizing `identity:get_user(user_id=a7aff02dbe9d4c34ad6d286018218135)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:44.518160 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae6b68-7a08-4857-ab75-d5946060d0bf admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:44.519719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Jul 26 10:12:44 2022] GET /identity/v3/users/a7aff02dbe9d4c34ad6d286018218135 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:46.785838 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a79b26-49d4-4b9c-9f38-4be4bf462519 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.786393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a79b26-49d4-4b9c-9f38-4be4bf462519 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.786393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a79b26-49d4-4b9c-9f38-4be4bf462519 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.787760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:46.793573 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58292741-fa5a-4edc-bcb8-857723c40393 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.794028 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58292741-fa5a-4edc-bcb8-857723c40393 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.794122 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58292741-fa5a-4edc-bcb8-857723c40393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.797759 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd79fc-19f4-4a7e-baef-658036daf704 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.798159 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd79fc-19f4-4a7e-baef-658036daf704 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.798612 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd79fc-19f4-4a7e-baef-658036daf704 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.800641 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:46.807918 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfe463-d019-4f1c-af57-f9a726175540 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.808325 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfe463-d019-4f1c-af57-f9a726175540 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.808739 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfe463-d019-4f1c-af57-f9a726175540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.820098 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-58292741-fa5a-4edc-bcb8-857723c40393 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:46.821323 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-58292741-fa5a-4edc-bcb8-857723c40393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:46.853928 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG passlib.handlers.bcrypt [None req-e2cfe463-d019-4f1c-af57-f9a726175540 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87124) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 10:12:46.854375 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG passlib.handlers.bcrypt [None req-e2cfe463-d019-4f1c-af57-f9a726175540 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87124) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 10:12:46.900158 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-e2cfe463-d019-4f1c-af57-f9a726175540 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:46.902272 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-e2cfe463-d019-4f1c-af57-f9a726175540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:46.909034 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:46.941935 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58292741-fa5a-4edc-bcb8-857723c40393 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:46.967606 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:47.021739 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:47.045195 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfe463-d019-4f1c-af57-f9a726175540 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.059818 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58292741-fa5a-4edc-bcb8-857723c40393 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.094681 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19174b-65ed-4932-af94-d86028e7e9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.095332 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19174b-65ed-4932-af94-d86028e7e9c9 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.096184 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19174b-65ed-4932-af94-d86028e7e9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.096184 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19174b-65ed-4932-af94-d86028e7e9c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.107422 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19174b-65ed-4932-af94-d86028e7e9c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-7b19174b-65ed-4932-af94-d86028e7e9c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:47.116368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:47.117467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:47.118413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:47.118413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:47.118413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:47.118413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:47.118413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:47.118413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:47.118413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:47.118413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:47.118413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:47.118413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:47.118413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:47.118413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:12:47.118413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:12:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:47.123547 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19174b-65ed-4932-af94-d86028e7e9c9 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.151581 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfe463-d019-4f1c-af57-f9a726175540 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.154077 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:47.191506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721de3b8-7eb1-4e58-ad63-a028d3981c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.192409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de3b8-7eb1-4e58-ad63-a028d3981c02 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.192690 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de3b8-7eb1-4e58-ad63-a028d3981c02 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.192964 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de3b8-7eb1-4e58-ad63-a028d3981c02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.209608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:47.228147 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19174b-65ed-4932-af94-d86028e7e9c9 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.261550 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721de3b8-7eb1-4e58-ad63-a028d3981c02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.261754 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3759f-96cc-4d8f-90cb-05b533558c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.262362 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3759f-96cc-4d8f-90cb-05b533558c43 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.262669 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3759f-96cc-4d8f-90cb-05b533558c43 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.262945 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3759f-96cc-4d8f-90cb-05b533558c43 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.263128 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721de3b8-7eb1-4e58-ad63-a028d3981c02 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.263667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3759f-96cc-4d8f-90cb-05b533558c43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:47.263972 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3759f-96cc-4d8f-90cb-05b533558c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.265350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3759f-96cc-4d8f-90cb-05b533558c43 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.278904 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:47.284901 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3759f-96cc-4d8f-90cb-05b533558c43 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.376616 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:47.382424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721de3b8-7eb1-4e58-ad63-a028d3981c02 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.385210 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:47.388657 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3759f-96cc-4d8f-90cb-05b533558c43 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.428627 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c649e7d-7b5c-406c-b7aa-41d6bcb5cd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.429332 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c649e7d-7b5c-406c-b7aa-41d6bcb5cd30 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.429645 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c649e7d-7b5c-406c-b7aa-41d6bcb5cd30 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.429923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c649e7d-7b5c-406c-b7aa-41d6bcb5cd30 None admin] PATH_INFO: `/v3/users/a7aff02dbe9d4c34ad6d286018218135` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.431212 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c649e7d-7b5c-406c-b7aa-41d6bcb5cd30 None admin] RBAC: Authorizing `identity:get_user(user_id=a7aff02dbe9d4c34ad6d286018218135)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.432710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c649e7d-7b5c-406c-b7aa-41d6bcb5cd30 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.434338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 9/17] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/users/a7aff02dbe9d4c34ad6d286018218135 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:47.439865 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c649e7d-7b5c-406c-b7aa-41d6bcb5cd30 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.454989 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:47.486133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721de3b8-7eb1-4e58-ad63-a028d3981c02 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.525697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a207da1-f06f-4428-aaa6-133da769d744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.526634 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a207da1-f06f-4428-aaa6-133da769d744 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.526897 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a207da1-f06f-4428-aaa6-133da769d744 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.527164 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a207da1-f06f-4428-aaa6-133da769d744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.548083 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c649e7d-7b5c-406c-b7aa-41d6bcb5cd30 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.548413 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a207da1-f06f-4428-aaa6-133da769d744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.549899 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a207da1-f06f-4428-aaa6-133da769d744 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.568173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-6a207da1-f06f-4428-aaa6-133da769d744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:47.568173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:47.568173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:47.568173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:47.568173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:47.568173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:47.568173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:47.568173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:47.568173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:47.568173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:47.568173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:47.568173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:47.568173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:47.568173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:47.568173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:47.569281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:47.570099 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:47.570099 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:47.570099 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:47.570099 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:12:47.570099 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 9/18] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:47.576125 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a207da1-f06f-4428-aaa6-133da769d744 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.588193 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7d4bf-fe99-4b17-9014-dbcf143be13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.588846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7d4bf-fe99-4b17-9014-dbcf143be13c None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.589115 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7d4bf-fe99-4b17-9014-dbcf143be13c None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.589383 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7d4bf-fe99-4b17-9014-dbcf143be13c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.590642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7d4bf-fe99-4b17-9014-dbcf143be13c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.592129 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7d4bf-fe99-4b17-9014-dbcf143be13c None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.594017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 10/19] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:47.599778 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7d4bf-fe99-4b17-9014-dbcf143be13c None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.636005 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:47.686087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a207da1-f06f-4428-aaa6-133da769d744 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.690239 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:47.709446 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7d4bf-fe99-4b17-9014-dbcf143be13c None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.721500 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd475a4-7235-4d01-b3ef-3d54b641062e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.722140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd475a4-7235-4d01-b3ef-3d54b641062e None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.722422 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd475a4-7235-4d01-b3ef-3d54b641062e None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.722748 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd475a4-7235-4d01-b3ef-3d54b641062e None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.723476 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd475a4-7235-4d01-b3ef-3d54b641062e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:47.723768 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd475a4-7235-4d01-b3ef-3d54b641062e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.725181 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd475a4-7235-4d01-b3ef-3d54b641062e None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.742924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 10/20] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:47.743887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3347e-c566-4bdc-a6c5-7a4a8b07e9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.744514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3347e-c566-4bdc-a6c5-7a4a8b07e9d1 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.744793 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3347e-c566-4bdc-a6c5-7a4a8b07e9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.745065 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3347e-c566-4bdc-a6c5-7a4a8b07e9d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.745867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3347e-c566-4bdc-a6c5-7a4a8b07e9d1 None admin] RBAC: Adding query filter params (role.id=7d88b748366a42929784db05d53fe473, scope.domain.id=default, user.id=a7aff02dbe9d4c34ad6d286018218135) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:47.746175 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3347e-c566-4bdc-a6c5-7a4a8b07e9d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.747706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3347e-c566-4bdc-a6c5-7a4a8b07e9d1 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.758768 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 11/21] 10.222.0.60 () {56 vars in 1322 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/role_assignments?user.id=a7aff02dbe9d4c34ad6d286018218135&scope.domain.id=default&role.id=7d88b748366a42929784db05d53fe473 => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:50.242485 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d1ac8-09e4-41b5-a3ff-50c5f7859148 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.242997 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d1ac8-09e4-41b5-a3ff-50c5f7859148 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.243068 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d1ac8-09e4-41b5-a3ff-50c5f7859148 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.244662 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 11/22] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:50.260612 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d8f47-460c-4fa4-8919-c7302959b09b None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.261567 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d8f47-460c-4fa4-8919-c7302959b09b None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.262054 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d8f47-460c-4fa4-8919-c7302959b09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.287005 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-2a4d8f47-460c-4fa4-8919-c7302959b09b None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:50.288514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-2a4d8f47-460c-4fa4-8919-c7302959b09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:50.385451 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 12/23] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:50.431982 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d1ac8-09e4-41b5-a3ff-50c5f7859148 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:50.598733 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d1ac8-09e4-41b5-a3ff-50c5f7859148 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:50.624166 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:50.653064 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333cef4-f027-4800-8b5f-b78d52ed62a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:50.653737 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333cef4-f027-4800-8b5f-b78d52ed62a3 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.654016 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333cef4-f027-4800-8b5f-b78d52ed62a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.654288 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333cef4-f027-4800-8b5f-b78d52ed62a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.669589 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333cef4-f027-4800-8b5f-b78d52ed62a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-1333cef4-f027-4800-8b5f-b78d52ed62a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:50.676596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:50.677467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:50.678697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:50.678697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:50.678697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:50.678697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:50.678697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:50.678697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:50.678697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:50.678697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:50.678697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:50.678697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:50.678697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:50.678697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:12:50.678697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 12/24] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:12:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:50.684699 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d8f47-460c-4fa4-8919-c7302959b09b None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:50.704142 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810904e1-e18e-4253-9846-61d0c5c253c5 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.704452 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810904e1-e18e-4253-9846-61d0c5c253c5 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.704707 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810904e1-e18e-4253-9846-61d0c5c253c5 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.706078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 13/25] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:12:50.712296 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e2bd-7f1f-48db-9209-f1453b3bbd70 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.712589 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e2bd-7f1f-48db-9209-f1453b3bbd70 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.712868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e2bd-7f1f-48db-9209-f1453b3bbd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.743525 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-3fd5e2bd-7f1f-48db-9209-f1453b3bbd70 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:50.744750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-3fd5e2bd-7f1f-48db-9209-f1453b3bbd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:50.784517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:50.812058 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d8f47-460c-4fa4-8919-c7302959b09b None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:50.856586 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b71c0-851d-439b-b9fa-36ad794cb82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:50.857144 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b71c0-851d-439b-b9fa-36ad794cb82d None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.857423 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b71c0-851d-439b-b9fa-36ad794cb82d None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.857699 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b71c0-851d-439b-b9fa-36ad794cb82d None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.858425 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b71c0-851d-439b-b9fa-36ad794cb82d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:50.858747 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b71c0-851d-439b-b9fa-36ad794cb82d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:50.860184 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b71c0-851d-439b-b9fa-36ad794cb82d None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:50.871073 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 14/26] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:12:50.872368 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e36f7-7876-4ed7-b35a-ef7308a9f2a0 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.872658 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e36f7-7876-4ed7-b35a-ef7308a9f2a0 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.872933 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e36f7-7876-4ed7-b35a-ef7308a9f2a0 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.874511 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 15/27] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:50.884643 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 13/28] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:50.886174 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7c88e-1914-481e-8335-4bdc1bf429a4 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.886646 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7c88e-1914-481e-8335-4bdc1bf429a4 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.887074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7c88e-1914-481e-8335-4bdc1bf429a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.890072 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b71c0-851d-439b-b9fa-36ad794cb82d None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:50.931151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-05b7c88e-1914-481e-8335-4bdc1bf429a4 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:50.933805 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-05b7c88e-1914-481e-8335-4bdc1bf429a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:51.103851 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 16/29] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:51.105748 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7c88e-1914-481e-8335-4bdc1bf429a4 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:51.112417 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b71c0-851d-439b-b9fa-36ad794cb82d None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:51.166980 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:51.172073 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376bdc0-f508-464f-9514-277b496d4b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:51.172742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376bdc0-f508-464f-9514-277b496d4b85 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.173023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376bdc0-f508-464f-9514-277b496d4b85 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.173299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376bdc0-f508-464f-9514-277b496d4b85 None admin] PATH_INFO: `/v3/users/a7aff02dbe9d4c34ad6d286018218135` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.174812 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376bdc0-f508-464f-9514-277b496d4b85 None admin] RBAC: Authorizing `identity:get_user(user_id=a7aff02dbe9d4c34ad6d286018218135)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:51.176345 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376bdc0-f508-464f-9514-277b496d4b85 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:51.178402 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 14/30] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:50 2022] GET /identity/v3/users/a7aff02dbe9d4c34ad6d286018218135 => generated 247 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:51.179209 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376bdc0-f508-464f-9514-277b496d4b85 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:51.183168 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:51.241548 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7c88e-1914-481e-8335-4bdc1bf429a4 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:51.277976 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f88df1-0fa1-4238-8ae6-96849663717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:51.278624 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f88df1-0fa1-4238-8ae6-96849663717d None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.278900 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f88df1-0fa1-4238-8ae6-96849663717d None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.279354 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f88df1-0fa1-4238-8ae6-96849663717d None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.280243 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f88df1-0fa1-4238-8ae6-96849663717d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:51.281904 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f88df1-0fa1-4238-8ae6-96849663717d None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:51.287101 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376bdc0-f508-464f-9514-277b496d4b85 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:51.324470 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf53a6-9fb7-4114-9e2f-c889655a9bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:51.325445 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf53a6-9fb7-4114-9e2f-c889655a9bc0 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.325882 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf53a6-9fb7-4114-9e2f-c889655a9bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.326301 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf53a6-9fb7-4114-9e2f-c889655a9bc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.338245 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf53a6-9fb7-4114-9e2f-c889655a9bc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:51.339967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf53a6-9fb7-4114-9e2f-c889655a9bc0 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:51.356276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-c7bf53a6-9fb7-4114-9e2f-c889655a9bc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:51.356276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:51.356276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:51.356276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:51.356276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:51.356276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:51.356276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:51.356276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:51.356276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:51.356276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:51.356276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:51.356276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:51.356276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:51.356276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:51.356276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:51.357348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:51.358354 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:51.358354 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:51.358354 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:51.358354 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:12:51.359921 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 15/31] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:51.361586 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6e2ac-036a-4841-9fb9-8f2dd1830704 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.362037 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6e2ac-036a-4841-9fb9-8f2dd1830704 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.362522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6e2ac-036a-4841-9fb9-8f2dd1830704 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.363926 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 16/32] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:51.365138 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6e2ac-036a-4841-9fb9-8f2dd1830704 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:51.426937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:51.427992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 17/33] 10.222.0.60 () {60 vars in 1131 bytes} [Tue Jul 26 10:12:51 2022] POST /identity/v3/roles => generated 219 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:12:51.429252 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f88df1-0fa1-4238-8ae6-96849663717d None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:51.483322 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6e2ac-036a-4841-9fb9-8f2dd1830704 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:51.532868 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cfe57-3e41-47ef-ac2a-139ea5e72142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:51.533532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cfe57-3e41-47ef-ac2a-139ea5e72142 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.533811 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cfe57-3e41-47ef-ac2a-139ea5e72142 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.534084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cfe57-3e41-47ef-ac2a-139ea5e72142 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.536120 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cfe57-3e41-47ef-ac2a-139ea5e72142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:51.538142 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cfe57-3e41-47ef-ac2a-139ea5e72142 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:51.543625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 17/34] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:51.543625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30d180-4a0d-404c-9e2d-5737044fa831 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.543625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30d180-4a0d-404c-9e2d-5737044fa831 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.543625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30d180-4a0d-404c-9e2d-5737044fa831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.553459 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:51.563596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f88df1-0fa1-4238-8ae6-96849663717d None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:51.569636 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-bb30d180-4a0d-404c-9e2d-5737044fa831 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:51.570933 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-bb30d180-4a0d-404c-9e2d-5737044fa831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:51.639283 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447abdbc-e570-4a0a-9b3a-3506b41cca34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:51.639948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447abdbc-e570-4a0a-9b3a-3506b41cca34 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.640230 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447abdbc-e570-4a0a-9b3a-3506b41cca34 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.640500 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447abdbc-e570-4a0a-9b3a-3506b41cca34 None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.641267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447abdbc-e570-4a0a-9b3a-3506b41cca34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:51.641572 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447abdbc-e570-4a0a-9b3a-3506b41cca34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:51.643168 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447abdbc-e570-4a0a-9b3a-3506b41cca34 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:51.668250 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 18/35] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:51.669155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30d180-4a0d-404c-9e2d-5737044fa831 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:51.670198 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 18/36] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:51.676440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447abdbc-e570-4a0a-9b3a-3506b41cca34 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:51.741511 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:51.792541 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30d180-4a0d-404c-9e2d-5737044fa831 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:51.816805 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447abdbc-e570-4a0a-9b3a-3506b41cca34 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:51.830227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b74e24-2093-437d-87e0-fc134184c4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:51.830977 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b74e24-2093-437d-87e0-fc134184c4e0 None admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.831259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b74e24-2093-437d-87e0-fc134184c4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.831601 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b74e24-2093-437d-87e0-fc134184c4e0 None admin] PATH_INFO: `/v3/domains/default/users/a7aff02dbe9d4c34ad6d286018218135/roles/7d88b748366a42929784db05d53fe473` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.835299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b74e24-2093-437d-87e0-fc134184c4e0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a7aff02dbe9d4c34ad6d286018218135, role_id=7d88b748366a42929784db05d53fe473)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:51.836187 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b74e24-2093-437d-87e0-fc134184c4e0 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:51.862067 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc31c13-0797-4e71-885d-2733486744fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:51.863098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc31c13-0797-4e71-885d-2733486744fe None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.863579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc31c13-0797-4e71-885d-2733486744fe None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.864047 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc31c13-0797-4e71-885d-2733486744fe None admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.865268 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc31c13-0797-4e71-885d-2733486744fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:51.867033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc31c13-0797-4e71-885d-2733486744fe None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:51.905392 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 19/37] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Jul 26 10:12:51 2022] POST /identity/v3/projects => generated 301 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:12:51.906775 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc31c13-0797-4e71-885d-2733486744fe None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:51.924511 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:51.977979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 19/38] 10.222.0.60 () {58 vars in 1361 bytes} [Tue Jul 26 10:12:51 2022] PUT /identity/v3/domains/default/users/a7aff02dbe9d4c34ad6d286018218135/roles/7d88b748366a42929784db05d53fe473 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:12:51.977979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc12e34-c310-4415-923c-44503a5e5812 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.977979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc12e34-c310-4415-923c-44503a5e5812 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.977979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc12e34-c310-4415-923c-44503a5e5812 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.980652 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 20/39] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:12:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:51.987047 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cad33-5849-4385-8974-fa71e8ef66f5 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.987366 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cad33-5849-4385-8974-fa71e8ef66f5 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.987612 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cad33-5849-4385-8974-fa71e8ef66f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.023006 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-899cad33-5849-4385-8974-fa71e8ef66f5 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:52.024679 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-899cad33-5849-4385-8974-fa71e8ef66f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:52.051683 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc31c13-0797-4e71-885d-2733486744fe None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:52.092371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51369450-4140-483b-b511-3428ce165e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:52.093043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51369450-4140-483b-b511-3428ce165e11 None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.093319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51369450-4140-483b-b511-3428ce165e11 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.093590 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51369450-4140-483b-b511-3428ce165e11 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.094412 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51369450-4140-483b-b511-3428ce165e11 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:52.095895 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51369450-4140-483b-b511-3428ce165e11 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:52.115153 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 20/40] 10.222.0.60 () {60 vars in 1131 bytes} [Tue Jul 26 10:12:51 2022] POST /identity/v3/roles => generated 225 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:12:52.116499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54828d-07c9-49e2-9d24-2a88059cbf6d None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.116790 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54828d-07c9-49e2-9d24-2a88059cbf6d None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.117066 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54828d-07c9-49e2-9d24-2a88059cbf6d None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.118105 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 21/41] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:52.118461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 21/42] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:52.124370 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59311b0-3578-4e56-98fe-1c5dc3adaa1a None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.125078 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59311b0-3578-4e56-98fe-1c5dc3adaa1a None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.125241 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59311b0-3578-4e56-98fe-1c5dc3adaa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.147142 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-d59311b0-3578-4e56-98fe-1c5dc3adaa1a None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:52.148503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-d59311b0-3578-4e56-98fe-1c5dc3adaa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:52.168203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54828d-07c9-49e2-9d24-2a88059cbf6d None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:52.219548 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:52.258236 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 22/43] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:12:52.271645 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:52.301955 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59311b0-3578-4e56-98fe-1c5dc3adaa1a None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:52.325281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54828d-07c9-49e2-9d24-2a88059cbf6d None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:52.378773 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e119c-fe5b-4148-a18a-11b6d9466cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:52.379665 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e119c-fe5b-4148-a18a-11b6d9466cf7 None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.380122 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e119c-fe5b-4148-a18a-11b6d9466cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.380553 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e119c-fe5b-4148-a18a-11b6d9466cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.381444 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e119c-fe5b-4148-a18a-11b6d9466cf7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:52.383196 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e119c-fe5b-4148-a18a-11b6d9466cf7 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:52.403767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 22/44] 10.222.0.60 () {60 vars in 1131 bytes} [Tue Jul 26 10:12:52 2022] POST /identity/v3/roles => generated 223 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:12:52.462155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59311b0-3578-4e56-98fe-1c5dc3adaa1a None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:52.504852 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995e2bb-505d-4dbe-b256-c55237f54ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:52.505582 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995e2bb-505d-4dbe-b256-c55237f54ff8 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.505867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995e2bb-505d-4dbe-b256-c55237f54ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.506139 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995e2bb-505d-4dbe-b256-c55237f54ff8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.507391 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995e2bb-505d-4dbe-b256-c55237f54ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:52.509195 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995e2bb-505d-4dbe-b256-c55237f54ff8 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:52.511298 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 23/45] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:52.516986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e119c-fe5b-4148-a18a-11b6d9466cf7 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:52.636936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e119c-fe5b-4148-a18a-11b6d9466cf7 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:52.663935 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:52.673458 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1f958-35dc-4c0e-8a8d-d658f84ecd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:52.674081 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f958-35dc-4c0e-8a8d-d658f84ecd52 None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.674361 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f958-35dc-4c0e-8a8d-d658f84ecd52 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.674667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f958-35dc-4c0e-8a8d-d658f84ecd52 None admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.675358 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1f958-35dc-4c0e-8a8d-d658f84ecd52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:52.676835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1f958-35dc-4c0e-8a8d-d658f84ecd52 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:52.710566 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 23/46] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Jul 26 10:12:52 2022] POST /identity/v3/projects => generated 312 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:12:54.317931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16253531-3811-415e-a2cd-3061bc825de6 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.318668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16253531-3811-415e-a2cd-3061bc825de6 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.318668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16253531-3811-415e-a2cd-3061bc825de6 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.319980 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 24/47] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:54.325256 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75e8d3-03a1-4fbe-bbbe-7369aef81c13 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.325667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75e8d3-03a1-4fbe-bbbe-7369aef81c13 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.325804 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75e8d3-03a1-4fbe-bbbe-7369aef81c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.345375 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-be75e8d3-03a1-4fbe-bbbe-7369aef81c13 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:54.347032 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-be75e8d3-03a1-4fbe-bbbe-7369aef81c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:54.419164 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 24/48] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:54.442885 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16253531-3811-415e-a2cd-3061bc825de6 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:54.489994 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:54.552052 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16253531-3811-415e-a2cd-3061bc825de6 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:54.592869 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600fa46-7052-48e7-80ab-c85212550006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:54.593067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600fa46-7052-48e7-80ab-c85212550006 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.593276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600fa46-7052-48e7-80ab-c85212550006 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.593765 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600fa46-7052-48e7-80ab-c85212550006 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.605799 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600fa46-7052-48e7-80ab-c85212550006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-b600fa46-7052-48e7-80ab-c85212550006 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:54.611697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:54.612538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:54.613288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:54.613288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:54.613288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:54.613288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:54.613288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:54.613288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:54.613288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:54.613288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:54.613288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:54.613288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:54.613288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:54.613288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:12:54.613288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 25/49] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:12:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:54.618936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75e8d3-03a1-4fbe-bbbe-7369aef81c13 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:54.724434 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75e8d3-03a1-4fbe-bbbe-7369aef81c13 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:54.736218 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:54.761487 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38008a85-2043-4e93-9d7d-d1bcd6582bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:54.762121 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38008a85-2043-4e93-9d7d-d1bcd6582bd3 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.762400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38008a85-2043-4e93-9d7d-d1bcd6582bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.762705 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38008a85-2043-4e93-9d7d-d1bcd6582bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.763429 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38008a85-2043-4e93-9d7d-d1bcd6582bd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:54.763733 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38008a85-2043-4e93-9d7d-d1bcd6582bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:54.765243 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38008a85-2043-4e93-9d7d-d1bcd6582bd3 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:54.777213 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 25/50] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:54.783101 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600fa46-7052-48e7-80ab-c85212550006 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:54.893530 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600fa46-7052-48e7-80ab-c85212550006 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:54.897389 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:54.933725 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c818f12-e49d-460b-b6a4-be47784e9436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:54.934376 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c818f12-e49d-460b-b6a4-be47784e9436 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.934687 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c818f12-e49d-460b-b6a4-be47784e9436 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.934960 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c818f12-e49d-460b-b6a4-be47784e9436 None admin] PATH_INFO: `/v3/users/a7aff02dbe9d4c34ad6d286018218135` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.936135 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c818f12-e49d-460b-b6a4-be47784e9436 None admin] RBAC: Authorizing `identity:get_user(user_id=a7aff02dbe9d4c34ad6d286018218135)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:54.937638 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c818f12-e49d-460b-b6a4-be47784e9436 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:54.939311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 26/51] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:54 2022] GET /identity/v3/users/a7aff02dbe9d4c34ad6d286018218135 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:54.944889 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38008a85-2043-4e93-9d7d-d1bcd6582bd3 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:54.994681 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177e422-c7b3-4bbf-b554-588e573f26d0 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.994972 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177e422-c7b3-4bbf-b554-588e573f26d0 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.995240 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177e422-c7b3-4bbf-b554-588e573f26d0 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.996636 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 27/52] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:55.001809 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc743725-6576-4e69-8b09-abb19ede5ec9 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.002095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc743725-6576-4e69-8b09-abb19ede5ec9 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.002378 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc743725-6576-4e69-8b09-abb19ede5ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.021680 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-bc743725-6576-4e69-8b09-abb19ede5ec9 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:55.022959 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-bc743725-6576-4e69-8b09-abb19ede5ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:55.057091 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38008a85-2043-4e93-9d7d-d1bcd6582bd3 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:55.090262 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 28/53] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:55.090773 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9f9d4-eba2-41b2-b7f3-7b3ae00dae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:55.091430 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9f9d4-eba2-41b2-b7f3-7b3ae00dae5b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.091716 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9f9d4-eba2-41b2-b7f3-7b3ae00dae5b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.091992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9f9d4-eba2-41b2-b7f3-7b3ae00dae5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.093190 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9f9d4-eba2-41b2-b7f3-7b3ae00dae5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:55.094763 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9f9d4-eba2-41b2-b7f3-7b3ae00dae5b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:55.096378 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 26/54] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:55.102205 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc743725-6576-4e69-8b09-abb19ede5ec9 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:55.113994 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9f9d4-eba2-41b2-b7f3-7b3ae00dae5b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:55.159110 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:55.199346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:55.202913 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc743725-6576-4e69-8b09-abb19ede5ec9 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:55.218753 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9f9d4-eba2-41b2-b7f3-7b3ae00dae5b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:55.239015 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a7eb1-d0b0-439b-b7b0-751046743fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:55.239647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a7eb1-d0b0-439b-b7b0-751046743fa0 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.239926 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a7eb1-d0b0-439b-b7b0-751046743fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.240227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a7eb1-d0b0-439b-b7b0-751046743fa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.241022 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a7eb1-d0b0-439b-b7b0-751046743fa0 None admin] RBAC: Adding query filter params (role.id=7d88b748366a42929784db05d53fe473, scope.domain.id=default, user.id=a7aff02dbe9d4c34ad6d286018218135) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:55.241328 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a7eb1-d0b0-439b-b7b0-751046743fa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:55.242839 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a7eb1-d0b0-439b-b7b0-751046743fa0 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:55.248577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 29/55] 10.222.0.60 () {56 vars in 1322 bytes} [Tue Jul 26 10:12:55 2022] GET /identity/v3/role_assignments?user.id=a7aff02dbe9d4c34ad6d286018218135&scope.domain.id=default&role.id=7d88b748366a42929784db05d53fe473 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:55.251823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b192cc-70cc-40ab-990c-3727a3ad5005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:55.252490 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b192cc-70cc-40ab-990c-3727a3ad5005 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.252775 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b192cc-70cc-40ab-990c-3727a3ad5005 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.253059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b192cc-70cc-40ab-990c-3727a3ad5005 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.254273 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b192cc-70cc-40ab-990c-3727a3ad5005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:55.255787 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b192cc-70cc-40ab-990c-3727a3ad5005 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:55.257529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 27/56] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:55.263541 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a7eb1-d0b0-439b-b7b0-751046743fa0 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:55.373981 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a7eb1-d0b0-439b-b7b0-751046743fa0 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:55.412378 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45253222-1645-4d79-863e-e1ab5bee4d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:55.412934 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45253222-1645-4d79-863e-e1ab5bee4d2c None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.413218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45253222-1645-4d79-863e-e1ab5bee4d2c None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.413495 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45253222-1645-4d79-863e-e1ab5bee4d2c None admin] PATH_INFO: `/v3/projects` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.414228 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45253222-1645-4d79-863e-e1ab5bee4d2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:55.415831 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45253222-1645-4d79-863e-e1ab5bee4d2c None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:55.447706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 30/57] 10.222.0.60 () {60 vars in 1140 bytes} [Tue Jul 26 10:12:55 2022] POST /identity/v3/projects => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:12:57.691773 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a7f3d-8192-4f87-bdec-d1c6cecb421a None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:57.692323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a7f3d-8192-4f87-bdec-d1c6cecb421a None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:57.692479 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a7f3d-8192-4f87-bdec-d1c6cecb421a None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:57.694414 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 28/58] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:57.700884 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdceaec-b5bc-4260-861f-61ab70585cda None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:57.701617 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdceaec-b5bc-4260-861f-61ab70585cda None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:57.701783 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdceaec-b5bc-4260-861f-61ab70585cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:57.722348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-0fdceaec-b5bc-4260-861f-61ab70585cda None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:57.723569 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-0fdceaec-b5bc-4260-861f-61ab70585cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:57.735806 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:57.809172 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 31/59] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:57.841966 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a7f3d-8192-4f87-bdec-d1c6cecb421a None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:57.956944 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a7f3d-8192-4f87-bdec-d1c6cecb421a None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:57.965809 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:57.998923 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ec508-0565-40b8-8707-bdea4be235ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:57.999577 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ec508-0565-40b8-8707-bdea4be235ef None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:57.999864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ec508-0565-40b8-8707-bdea4be235ef None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:58.000169 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ec508-0565-40b8-8707-bdea4be235ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:58.001462 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ec508-0565-40b8-8707-bdea4be235ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:58.002979 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ec508-0565-40b8-8707-bdea4be235ef None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:58.004583 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 29/60] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:58.011059 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdceaec-b5bc-4260-861f-61ab70585cda None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:58.124179 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdceaec-b5bc-4260-861f-61ab70585cda None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:58.160264 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1a026-8482-46a3-b740-c79b3683796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:58.160885 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a026-8482-46a3-b740-c79b3683796c None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:58.161161 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a026-8482-46a3-b740-c79b3683796c None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:58.161433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a026-8482-46a3-b740-c79b3683796c None admin] PATH_INFO: `/v3/users` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:58.162108 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1a026-8482-46a3-b740-c79b3683796c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:58.163631 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1a026-8482-46a3-b740-c79b3683796c None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:58.194189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 32/61] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Jul 26 10:12:58 2022] POST /identity/v3/users => generated 275 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:13:01.629275 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecb33e-fb44-4e10-9709-00fc8caf7ecf None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:01.629275 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecb33e-fb44-4e10-9709-00fc8caf7ecf None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:01.629275 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecb33e-fb44-4e10-9709-00fc8caf7ecf None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:01.629275 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 30/62] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:01.636135 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562b569-1c20-4135-ba73-1dd89bece101 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:01.636871 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562b569-1c20-4135-ba73-1dd89bece101 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:01.636871 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562b569-1c20-4135-ba73-1dd89bece101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:01.646676 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:01.664146 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-d562b569-1c20-4135-ba73-1dd89bece101 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:01.666529 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-d562b569-1c20-4135-ba73-1dd89bece101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:01.762168 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 33/63] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:01.769379 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5b83-6dcd-494b-a4ac-fcdcea0072d8 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:01.769784 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5b83-6dcd-494b-a4ac-fcdcea0072d8 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:01.770162 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5b83-6dcd-494b-a4ac-fcdcea0072d8 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:01.776247 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 31/64] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:01.781818 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7489001-7ef6-4305-a56d-5d42e802ee88 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:01.782318 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7489001-7ef6-4305-a56d-5d42e802ee88 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:01.782796 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7489001-7ef6-4305-a56d-5d42e802ee88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:01.785403 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee5b83-6dcd-494b-a4ac-fcdcea0072d8 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:01.817949 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-b7489001-7ef6-4305-a56d-5d42e802ee88 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:01.820705 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-b7489001-7ef6-4305-a56d-5d42e802ee88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:01.958384 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 34/65] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:01.992257 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee5b83-6dcd-494b-a4ac-fcdcea0072d8 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:01.999305 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7489001-7ef6-4305-a56d-5d42e802ee88 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:02.042150 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf37e86-c980-4eb1-99bb-fdf8bc018fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:02.042979 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf37e86-c980-4eb1-99bb-fdf8bc018fe9 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.043325 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf37e86-c980-4eb1-99bb-fdf8bc018fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.043774 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf37e86-c980-4eb1-99bb-fdf8bc018fe9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.058583 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf37e86-c980-4eb1-99bb-fdf8bc018fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-9cf37e86-c980-4eb1-99bb-fdf8bc018fe9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:02.064803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:02.065738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:02.066767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:02.066767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:02.066767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:02.066767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:02.066767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:02.066767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:02.066767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:02.066767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:02.066767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:02.066767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:02.066767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:02.066767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:02.069335 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 32/66] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:02.071188 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acbd0a-2c3c-4e1d-b95c-e543cd7ca560 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.071695 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acbd0a-2c3c-4e1d-b95c-e543cd7ca560 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.072192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acbd0a-2c3c-4e1d-b95c-e543cd7ca560 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.074633 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 33/67] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:02.075759 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acbd0a-2c3c-4e1d-b95c-e543cd7ca560 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:02.092350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:02.121323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:02.145689 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7489001-7ef6-4305-a56d-5d42e802ee88 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:02.190805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4723bd-a4a6-4946-a751-3abe49cf3c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:02.191857 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4723bd-a4a6-4946-a751-3abe49cf3c92 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.192205 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4723bd-a4a6-4946-a751-3abe49cf3c92 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.192553 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4723bd-a4a6-4946-a751-3abe49cf3c92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.199603 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acbd0a-2c3c-4e1d-b95c-e543cd7ca560 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:02.206804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4723bd-a4a6-4946-a751-3abe49cf3c92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-8d4723bd-a4a6-4946-a751-3abe49cf3c92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:02.213648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:02.214674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:02.215710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:02.215710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:02.215710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:02.215710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:02.215710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:02.215710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:02.215710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:02.215710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:02.215710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:02.215710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:02.215710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:02.215710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:02.215710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 35/68] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:02.216898 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13c609-a30c-4989-b1d6-743c8365e7b4 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.218473 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13c609-a30c-4989-b1d6-743c8365e7b4 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.218473 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13c609-a30c-4989-b1d6-743c8365e7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.237560 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-9b13c609-a30c-4989-b1d6-743c8365e7b4 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:02.238809 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-9b13c609-a30c-4989-b1d6-743c8365e7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:02.239369 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d6de8-63bd-428d-b556-394731814086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:02.240035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d6de8-63bd-428d-b556-394731814086 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.240317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d6de8-63bd-428d-b556-394731814086 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.240581 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d6de8-63bd-428d-b556-394731814086 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.241321 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d6de8-63bd-428d-b556-394731814086 None admin] RBAC: Adding query filter params (name=member) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:02.241629 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d6de8-63bd-428d-b556-394731814086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:02.243063 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d6de8-63bd-428d-b556-394731814086 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:02.257740 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:02.257740 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bb33f-f379-4ca2-b160-04fa116d325d None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.257740 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bb33f-f379-4ca2-b160-04fa116d325d None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.257740 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bb33f-f379-4ca2-b160-04fa116d325d None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.257740 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 35/70] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:02.257740 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bb33f-f379-4ca2-b160-04fa116d325d None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:02.309280 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 36/71] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:02.318638 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13c609-a30c-4989-b1d6-743c8365e7b4 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:02.376053 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:02.385531 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:02.391400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bb33f-f379-4ca2-b160-04fa116d325d None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:02.425573 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23dcb1-ee92-45c8-971e-5b017239274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:02.426196 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23dcb1-ee92-45c8-971e-5b017239274a None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.426499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23dcb1-ee92-45c8-971e-5b017239274a None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.426772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23dcb1-ee92-45c8-971e-5b017239274a None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.427502 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23dcb1-ee92-45c8-971e-5b017239274a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:02.427805 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23dcb1-ee92-45c8-971e-5b017239274a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:02.429199 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23dcb1-ee92-45c8-971e-5b017239274a None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:02.430841 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13c609-a30c-4989-b1d6-743c8365e7b4 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:02.437247 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 36/72] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:02.438521 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85268029-d023-464f-bbac-39f6fe1a3434 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.438812 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85268029-d023-464f-bbac-39f6fe1a3434 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.439086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85268029-d023-464f-bbac-39f6fe1a3434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.457769 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-85268029-d023-464f-bbac-39f6fe1a3434 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:02.459064 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-85268029-d023-464f-bbac-39f6fe1a3434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:02.466358 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b493b-6b62-4f9a-a222-02155a9a34aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:02.466992 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b493b-6b62-4f9a-a222-02155a9a34aa None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.467269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b493b-6b62-4f9a-a222-02155a9a34aa None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.467834 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b493b-6b62-4f9a-a222-02155a9a34aa None admin] PATH_INFO: `/v3/users/2ea2941f7ce84e2c852c62634e0e040a` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.482506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b493b-6b62-4f9a-a222-02155a9a34aa None admin] RBAC: Authorizing `identity:get_user(user_id=2ea2941f7ce84e2c852c62634e0e040a)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:02.484052 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b493b-6b62-4f9a-a222-02155a9a34aa None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:02.485746 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 37/73] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:02 2022] GET /identity/v3/users/2ea2941f7ce84e2c852c62634e0e040a => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:02.486969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb758db-7c57-4b37-81be-ee43e8ae0ba9 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.487248 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb758db-7c57-4b37-81be-ee43e8ae0ba9 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.487521 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb758db-7c57-4b37-81be-ee43e8ae0ba9 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.488722 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 38/74] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:02.490775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb758db-7c57-4b37-81be-ee43e8ae0ba9 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:02.533568 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 37/75] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:02.534552 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85268029-d023-464f-bbac-39f6fe1a3434 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:02.598668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb758db-7c57-4b37-81be-ee43e8ae0ba9 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:02.610122 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:02.629488 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:02.636265 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1559f7-b27d-4e08-bd3b-19ae902fc495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:02.636933 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1559f7-b27d-4e08-bd3b-19ae902fc495 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.637225 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1559f7-b27d-4e08-bd3b-19ae902fc495 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.637495 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1559f7-b27d-4e08-bd3b-19ae902fc495 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.640044 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85268029-d023-464f-bbac-39f6fe1a3434 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:02.648036 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1559f7-b27d-4e08-bd3b-19ae902fc495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-aa1559f7-b27d-4e08-bd3b-19ae902fc495 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:02.653021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:02.654192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:02.655163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:02.655163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:02.655163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:02.655163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:02.655163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:02.655163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:02.655163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:02.655163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:02.655163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:02.655163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:02.655163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:02.655163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:02.655163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 39/76] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:02.656111 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1559f7-b27d-4e08-bd3b-19ae902fc495 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:02.679685 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a416485-a454-40a7-8750-f26e81f988f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:02.680340 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a416485-a454-40a7-8750-f26e81f988f3 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.680618 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a416485-a454-40a7-8750-f26e81f988f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.680887 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a416485-a454-40a7-8750-f26e81f988f3 None admin] PATH_INFO: `/v3/users/a7aff02dbe9d4c34ad6d286018218135` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.682313 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a416485-a454-40a7-8750-f26e81f988f3 None admin] RBAC: Authorizing `identity:get_user(user_id=a7aff02dbe9d4c34ad6d286018218135)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:02.683809 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a416485-a454-40a7-8750-f26e81f988f3 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:02.685681 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 38/77] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:02 2022] GET /identity/v3/users/a7aff02dbe9d4c34ad6d286018218135 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:02.686593 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2847147-2e3e-4945-bf83-5df091942b57 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.686936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2847147-2e3e-4945-bf83-5df091942b57 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.687292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2847147-2e3e-4945-bf83-5df091942b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.709212 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-b2847147-2e3e-4945-bf83-5df091942b57 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:02.710413 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-b2847147-2e3e-4945-bf83-5df091942b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:02.777534 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 39/78] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:02.777726 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1559f7-b27d-4e08-bd3b-19ae902fc495 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:02.778126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2847147-2e3e-4945-bf83-5df091942b57 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:02.812978 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2048f47-af18-4af6-90db-f1f4568fac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:02.813604 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2048f47-af18-4af6-90db-f1f4568fac1d None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.813882 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2048f47-af18-4af6-90db-f1f4568fac1d None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.814138 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2048f47-af18-4af6-90db-f1f4568fac1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.852837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:02.881972 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:02.884434 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2048f47-af18-4af6-90db-f1f4568fac1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:02.885993 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2048f47-af18-4af6-90db-f1f4568fac1d None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:02.894951 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2847147-2e3e-4945-bf83-5df091942b57 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:02.928966 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76326a-d4da-4a94-b404-ecb8f682e43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:02.929609 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76326a-d4da-4a94-b404-ecb8f682e43d None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.929884 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76326a-d4da-4a94-b404-ecb8f682e43d None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.930153 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76326a-d4da-4a94-b404-ecb8f682e43d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.931338 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76326a-d4da-4a94-b404-ecb8f682e43d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:02.932797 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76326a-d4da-4a94-b404-ecb8f682e43d None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:02.934389 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 40/79] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:02.935177 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76326a-d4da-4a94-b404-ecb8f682e43d None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:02.994421 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 40/80] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:02.995387 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2048f47-af18-4af6-90db-f1f4568fac1d None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.045630 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76326a-d4da-4a94-b404-ecb8f682e43d None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.071851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:03.087893 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f473fc-e7ed-45dd-8586-8585ea257b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.088523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f473fc-e7ed-45dd-8586-8585ea257b27 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.088800 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f473fc-e7ed-45dd-8586-8585ea257b27 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.089067 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f473fc-e7ed-45dd-8586-8585ea257b27 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.089828 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f473fc-e7ed-45dd-8586-8585ea257b27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:03.090109 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f473fc-e7ed-45dd-8586-8585ea257b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:03.091587 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f473fc-e7ed-45dd-8586-8585ea257b27 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:03.100439 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 41/81] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:03.101310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f473fc-e7ed-45dd-8586-8585ea257b27 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.107981 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2048f47-af18-4af6-90db-f1f4568fac1d None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.122088 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:03.151069 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa9cf0-8b5f-4f39-a666-96f7b4a5ad7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.152013 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa9cf0-8b5f-4f39-a666-96f7b4a5ad7b None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.152461 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa9cf0-8b5f-4f39-a666-96f7b4a5ad7b None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.152881 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa9cf0-8b5f-4f39-a666-96f7b4a5ad7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.215176 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f473fc-e7ed-45dd-8586-8585ea257b27 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.232583 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa9cf0-8b5f-4f39-a666-96f7b4a5ad7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:03.235940 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa9cf0-8b5f-4f39-a666-96f7b4a5ad7b None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:03.249642 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86819774-6dc2-4af7-84fc-b6ba1be53f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.250298 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86819774-6dc2-4af7-84fc-b6ba1be53f29 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.250610 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86819774-6dc2-4af7-84fc-b6ba1be53f29 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.250887 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86819774-6dc2-4af7-84fc-b6ba1be53f29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.261392 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86819774-6dc2-4af7-84fc-b6ba1be53f29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-86819774-6dc2-4af7-84fc-b6ba1be53f29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:03.266881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:03.267871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:03.268868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:03.268868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:03.268868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:03.268868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:03.268868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:03.268868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:03.268868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:03.268868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:03.268868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:03.268868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:03.268868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:03.268868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:03.268868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 42/82] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:03.268868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86819774-6dc2-4af7-84fc-b6ba1be53f29 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.312589 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:03.346338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 41/83] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:03.348485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa9cf0-8b5f-4f39-a666-96f7b4a5ad7b None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.352354 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:03.378468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86819774-6dc2-4af7-84fc-b6ba1be53f29 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.414155 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27df25-b26c-4741-9feb-dbec2de1fb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.414782 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27df25-b26c-4741-9feb-dbec2de1fb2f None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.415082 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27df25-b26c-4741-9feb-dbec2de1fb2f None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.415354 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27df25-b26c-4741-9feb-dbec2de1fb2f None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.416428 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27df25-b26c-4741-9feb-dbec2de1fb2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:03.417915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27df25-b26c-4741-9feb-dbec2de1fb2f None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:03.445886 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 43/84] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Jul 26 10:13:03 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:03.446765 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27df25-b26c-4741-9feb-dbec2de1fb2f None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.459450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa9cf0-8b5f-4f39-a666-96f7b4a5ad7b None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.499359 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecfda3-0bfe-4cee-ae04-73215aef5647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.500107 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecfda3-0bfe-4cee-ae04-73215aef5647 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.500502 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecfda3-0bfe-4cee-ae04-73215aef5647 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.500778 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecfda3-0bfe-4cee-ae04-73215aef5647 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.502693 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecfda3-0bfe-4cee-ae04-73215aef5647 None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:03.504588 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecfda3-0bfe-4cee-ae04-73215aef5647 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:03.506970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 42/85] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:03 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:03.507559 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecfda3-0bfe-4cee-ae04-73215aef5647 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.557693 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:03.571996 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27df25-b26c-4741-9feb-dbec2de1fb2f None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.614784 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e05a7d-7a3c-4497-a650-c4e549832398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.615457 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e05a7d-7a3c-4497-a650-c4e549832398 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.615844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e05a7d-7a3c-4497-a650-c4e549832398 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.616117 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e05a7d-7a3c-4497-a650-c4e549832398 None admin] PATH_INFO: `/v3/users/2ea2941f7ce84e2c852c62634e0e040a` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.617474 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e05a7d-7a3c-4497-a650-c4e549832398 None admin] RBAC: Authorizing `identity:get_user(user_id=2ea2941f7ce84e2c852c62634e0e040a)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:03.619194 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e05a7d-7a3c-4497-a650-c4e549832398 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:03.625826 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 44/86] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:03 2022] GET /identity/v3/users/2ea2941f7ce84e2c852c62634e0e040a => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:03.625826 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e05a7d-7a3c-4497-a650-c4e549832398 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.625826 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:03.632605 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecfda3-0bfe-4cee-ae04-73215aef5647 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.686422 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d2757-6a79-4515-9d86-3a2545e10989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.687224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d2757-6a79-4515-9d86-3a2545e10989 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.687412 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d2757-6a79-4515-9d86-3a2545e10989 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.687665 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d2757-6a79-4515-9d86-3a2545e10989 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.688399 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d2757-6a79-4515-9d86-3a2545e10989 None admin] RBAC: Adding query filter params (name=member) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:03.688707 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d2757-6a79-4515-9d86-3a2545e10989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:03.690128 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d2757-6a79-4515-9d86-3a2545e10989 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:03.700029 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 43/87] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:03.700885 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d2757-6a79-4515-9d86-3a2545e10989 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.766946 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e05a7d-7a3c-4497-a650-c4e549832398 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.813057 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7cae9-731e-44b5-934b-9da17b277cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.813722 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7cae9-731e-44b5-934b-9da17b277cc5 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.814001 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7cae9-731e-44b5-934b-9da17b277cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.814274 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7cae9-731e-44b5-934b-9da17b277cc5 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.815561 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7cae9-731e-44b5-934b-9da17b277cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:03.817032 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7cae9-731e-44b5-934b-9da17b277cc5 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:03.819056 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 45/88] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:03 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:03.819852 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7cae9-731e-44b5-934b-9da17b277cc5 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.836240 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:03.840496 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d2757-6a79-4515-9d86-3a2545e10989 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.890519 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa425c-83d6-46c8-82f3-1e52be68c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.891160 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa425c-83d6-46c8-82f3-1e52be68c95d None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.891487 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa425c-83d6-46c8-82f3-1e52be68c95d None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.891821 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa425c-83d6-46c8-82f3-1e52be68c95d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.892638 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa425c-83d6-46c8-82f3-1e52be68c95d None admin] RBAC: Adding query filter params (role.id=c483c855d04b4145a203e1f0eedf3c0c, scope.project.id=da2d23ccca37438b90e87196aa0fbe36, user.id=2ea2941f7ce84e2c852c62634e0e040a) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:03.892957 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa425c-83d6-46c8-82f3-1e52be68c95d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:03.894602 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa425c-83d6-46c8-82f3-1e52be68c95d None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:03.900939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 44/89] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:03 2022] GET /identity/v3/role_assignments?user.id=2ea2941f7ce84e2c852c62634e0e040a&scope.project.id=da2d23ccca37438b90e87196aa0fbe36&role.id=c483c855d04b4145a203e1f0eedf3c0c => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:03.901833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa425c-83d6-46c8-82f3-1e52be68c95d None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.902701 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:03.939756 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7cae9-731e-44b5-934b-9da17b277cc5 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.977375 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5e685-2f9b-42b4-a53f-44ac38ba1792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.978303 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5e685-2f9b-42b4-a53f-44ac38ba1792 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.978759 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5e685-2f9b-42b4-a53f-44ac38ba1792 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.979186 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5e685-2f9b-42b4-a53f-44ac38ba1792 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.024011 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa425c-83d6-46c8-82f3-1e52be68c95d None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:04.055518 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5e685-2f9b-42b4-a53f-44ac38ba1792 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.057431 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5e685-2f9b-42b4-a53f-44ac38ba1792 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.095528 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a61fc7-0148-4e0a-8235-3b6532389f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:04.096127 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61fc7-0148-4e0a-8235-3b6532389f2d None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.096437 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61fc7-0148-4e0a-8235-3b6532389f2d None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.096767 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61fc7-0148-4e0a-8235-3b6532389f2d None admin] PATH_INFO: `/v3/users/2ea2941f7ce84e2c852c62634e0e040a` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.098629 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a61fc7-0148-4e0a-8235-3b6532389f2d None admin] RBAC: Authorizing `identity:get_user(user_id=2ea2941f7ce84e2c852c62634e0e040a)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.106834 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a61fc7-0148-4e0a-8235-3b6532389f2d None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.108693 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 45/90] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:03 2022] GET /identity/v3/users/2ea2941f7ce84e2c852c62634e0e040a => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:04.109649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a61fc7-0148-4e0a-8235-3b6532389f2d None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:04.146845 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:04.164230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:04.210097 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 46/91] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:04.213780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5e685-2f9b-42b4-a53f-44ac38ba1792 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:04.300496 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a61fc7-0148-4e0a-8235-3b6532389f2d None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:04.357072 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35c0b8-fdce-4577-ae93-a841c193edd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:04.357632 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35c0b8-fdce-4577-ae93-a841c193edd4 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.357917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35c0b8-fdce-4577-ae93-a841c193edd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.358193 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35c0b8-fdce-4577-ae93-a841c193edd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.359272 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35c0b8-fdce-4577-ae93-a841c193edd4 None admin] RBAC: Adding query filter params (role.id=7d88b748366a42929784db05d53fe473, scope.project.id=da2d23ccca37438b90e87196aa0fbe36, user.id=a7aff02dbe9d4c34ad6d286018218135) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:04.359495 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35c0b8-fdce-4577-ae93-a841c193edd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.360984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35c0b8-fdce-4577-ae93-a841c193edd4 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.367532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 46/92] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:04 2022] GET /identity/v3/role_assignments?user.id=a7aff02dbe9d4c34ad6d286018218135&scope.project.id=da2d23ccca37438b90e87196aa0fbe36&role.id=7d88b748366a42929784db05d53fe473 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:04.368399 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35c0b8-fdce-4577-ae93-a841c193edd4 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:04.386476 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5e685-2f9b-42b4-a53f-44ac38ba1792 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:04.427090 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da093bf-d280-4c6c-a0cf-2bd70b0998ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:04.428201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da093bf-d280-4c6c-a0cf-2bd70b0998ca None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.428675 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da093bf-d280-4c6c-a0cf-2bd70b0998ca None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.429137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da093bf-d280-4c6c-a0cf-2bd70b0998ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.521424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:04.553445 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:04.566600 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35c0b8-fdce-4577-ae93-a841c193edd4 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:04.583142 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da093bf-d280-4c6c-a0cf-2bd70b0998ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.585356 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da093bf-d280-4c6c-a0cf-2bd70b0998ca None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.671247 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea207e6-8b71-46ff-ac08-d0e382345771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:04.672155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea207e6-8b71-46ff-ac08-d0e382345771 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.672362 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea207e6-8b71-46ff-ac08-d0e382345771 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.672635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea207e6-8b71-46ff-ac08-d0e382345771 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.674021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea207e6-8b71-46ff-ac08-d0e382345771 None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.675536 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea207e6-8b71-46ff-ac08-d0e382345771 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.682220 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 47/93] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:04 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:04.690482 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea207e6-8b71-46ff-ac08-d0e382345771 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:04.721568 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 47/94] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:04.727781 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da093bf-d280-4c6c-a0cf-2bd70b0998ca None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:04.799113 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:04.833102 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da093bf-d280-4c6c-a0cf-2bd70b0998ca None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:04.863034 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea207e6-8b71-46ff-ac08-d0e382345771 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:04.872521 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13535e6-4f48-49f9-b736-a4b6df841a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:04.873625 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13535e6-4f48-49f9-b736-a4b6df841a1d None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.874150 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13535e6-4f48-49f9-b736-a4b6df841a1d None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.874772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13535e6-4f48-49f9-b736-a4b6df841a1d None admin] PATH_INFO: `/v3/projects/c62a83be94084167974e9ec84f6f7149` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.876274 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13535e6-4f48-49f9-b736-a4b6df841a1d None admin] RBAC: Authorizing `identity:get_project(project_id=c62a83be94084167974e9ec84f6f7149)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.878150 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13535e6-4f48-49f9-b736-a4b6df841a1d None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.880104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 48/95] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:04 2022] GET /identity/v3/projects/c62a83be94084167974e9ec84f6f7149 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:04.889929 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13535e6-4f48-49f9-b736-a4b6df841a1d None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:04.898418 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd27ba-5d6b-4fe2-b14a-3d03e29e9407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:04.898418 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd27ba-5d6b-4fe2-b14a-3d03e29e9407 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.898418 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd27ba-5d6b-4fe2-b14a-3d03e29e9407 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.898418 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd27ba-5d6b-4fe2-b14a-3d03e29e9407 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.902835 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd27ba-5d6b-4fe2-b14a-3d03e29e9407 None admin] RBAC: Adding query filter params (role.id=2ae24c72c8264d0ba34cbe573083cc33, scope.project.id=da2d23ccca37438b90e87196aa0fbe36, user.id=2ea2941f7ce84e2c852c62634e0e040a) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:04.902835 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd27ba-5d6b-4fe2-b14a-3d03e29e9407 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.902835 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd27ba-5d6b-4fe2-b14a-3d03e29e9407 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.908184 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 48/96] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:04 2022] GET /identity/v3/role_assignments?user.id=2ea2941f7ce84e2c852c62634e0e040a&scope.project.id=da2d23ccca37438b90e87196aa0fbe36&role.id=2ae24c72c8264d0ba34cbe573083cc33 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:05.040287 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13535e6-4f48-49f9-b736-a4b6df841a1d None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:05.078555 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339bb85-d409-4a3a-bb65-5cd40a76de96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:05.079253 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339bb85-d409-4a3a-bb65-5cd40a76de96 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:05.079535 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339bb85-d409-4a3a-bb65-5cd40a76de96 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:05.079812 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339bb85-d409-4a3a-bb65-5cd40a76de96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:05.080627 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339bb85-d409-4a3a-bb65-5cd40a76de96 None admin] RBAC: Adding query filter params (role.id=c483c855d04b4145a203e1f0eedf3c0c, scope.project.id=c62a83be94084167974e9ec84f6f7149, user.id=2ea2941f7ce84e2c852c62634e0e040a) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:05.080940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339bb85-d409-4a3a-bb65-5cd40a76de96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:05.082461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339bb85-d409-4a3a-bb65-5cd40a76de96 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:05.092092 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 49/97] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:04 2022] GET /identity/v3/role_assignments?user.id=2ea2941f7ce84e2c852c62634e0e040a&scope.project.id=c62a83be94084167974e9ec84f6f7149&role.id=c483c855d04b4145a203e1f0eedf3c0c => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:06.605700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae836-3556-4ffc-a62a-42c784065a65 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:06.606852 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae836-3556-4ffc-a62a-42c784065a65 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:06.607367 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae836-3556-4ffc-a62a-42c784065a65 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:06.609143 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 49/98] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:06.618241 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ceb78-b3a5-44bc-8ac1-cb9f4d582e74 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:06.619276 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ceb78-b3a5-44bc-8ac1-cb9f4d582e74 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:06.619764 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ceb78-b3a5-44bc-8ac1-cb9f4d582e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:06.630557 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:06.643189 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-448ceb78-b3a5-44bc-8ac1-cb9f4d582e74 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:06.644392 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-448ceb78-b3a5-44bc-8ac1-cb9f4d582e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:06.716300 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f560f-3efa-440e-827f-fafe930bea2d None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:06.716657 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f560f-3efa-440e-827f-fafe930bea2d None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:06.716855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f560f-3efa-440e-827f-fafe930bea2d None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:06.718670 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 50/99] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:06.731114 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcd5ef-41e1-4a53-b144-9d3580cded46 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:06.731454 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcd5ef-41e1-4a53-b144-9d3580cded46 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:06.731667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcd5ef-41e1-4a53-b144-9d3580cded46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:06.753551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 50/100] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:06.761486 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-eedcd5ef-41e1-4a53-b144-9d3580cded46 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:06.762716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-eedcd5ef-41e1-4a53-b144-9d3580cded46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:06.791232 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:06.812838 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ceb78-b3a5-44bc-8ac1-cb9f4d582e74 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:06.869754 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 51/101] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:06.912036 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcd5ef-41e1-4a53-b144-9d3580cded46 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:07.007034 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ceb78-b3a5-44bc-8ac1-cb9f4d582e74 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:07.074253 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:07.079499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d79ca4-8e18-4f18-b46e-a43de88133f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:07.080617 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d79ca4-8e18-4f18-b46e-a43de88133f3 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.081035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d79ca4-8e18-4f18-b46e-a43de88133f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.081448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d79ca4-8e18-4f18-b46e-a43de88133f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.106500 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d79ca4-8e18-4f18-b46e-a43de88133f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-c3d79ca4-8e18-4f18-b46e-a43de88133f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:07.111921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:07.113052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:07.114012 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:07.114012 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:07.114012 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:07.114012 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:07.114012 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:07.114012 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:07.114012 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:07.114012 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:07.114012 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:07.114012 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:07.114012 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:07.114012 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:07.122837 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 51/102] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:07.128477 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d79ca4-8e18-4f18-b46e-a43de88133f3 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:07.134700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcd5ef-41e1-4a53-b144-9d3580cded46 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:07.213428 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31642948-3c33-4eef-93bb-8554f7fa015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:07.214384 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31642948-3c33-4eef-93bb-8554f7fa015d None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.214814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31642948-3c33-4eef-93bb-8554f7fa015d None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.215229 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31642948-3c33-4eef-93bb-8554f7fa015d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.217703 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31642948-3c33-4eef-93bb-8554f7fa015d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:07.219487 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31642948-3c33-4eef-93bb-8554f7fa015d None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:07.221270 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 52/103] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:07.226958 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31642948-3c33-4eef-93bb-8554f7fa015d None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:07.278810 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:07.317582 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d79ca4-8e18-4f18-b46e-a43de88133f3 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:07.386268 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca536ef-adf7-4a0e-aec6-7d35e09a048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:07.387165 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca536ef-adf7-4a0e-aec6-7d35e09a048f None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.387588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca536ef-adf7-4a0e-aec6-7d35e09a048f None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.387997 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca536ef-adf7-4a0e-aec6-7d35e09a048f None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.388865 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca536ef-adf7-4a0e-aec6-7d35e09a048f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:07.389308 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca536ef-adf7-4a0e-aec6-7d35e09a048f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:07.392342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca536ef-adf7-4a0e-aec6-7d35e09a048f None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:07.411472 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 52/104] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:07.414002 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a5997-8e5d-4576-91ae-e4d5de5f8c3e None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.416854 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a5997-8e5d-4576-91ae-e4d5de5f8c3e None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.417290 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a5997-8e5d-4576-91ae-e4d5de5f8c3e None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.418788 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 53/105] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:07.426469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a5997-8e5d-4576-91ae-e4d5de5f8c3e None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:07.437235 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31642948-3c33-4eef-93bb-8554f7fa015d None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:07.494903 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:07.539785 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abfed1-fda7-4b71-ae3f-3f46eb56ec69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:07.541015 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abfed1-fda7-4b71-ae3f-3f46eb56ec69 None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.541203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abfed1-fda7-4b71-ae3f-3f46eb56ec69 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.541582 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abfed1-fda7-4b71-ae3f-3f46eb56ec69 None admin] PATH_INFO: `/v3/projects` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.542385 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abfed1-fda7-4b71-ae3f-3f46eb56ec69 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:07.543946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abfed1-fda7-4b71-ae3f-3f46eb56ec69 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:07.545539 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a5997-8e5d-4576-91ae-e4d5de5f8c3e None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:07.583147 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62f9d9-e399-490f-bb00-bd39686d861d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:07.584173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62f9d9-e399-490f-bb00-bd39686d861d None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.584681 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62f9d9-e399-490f-bb00-bd39686d861d None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.585140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62f9d9-e399-490f-bb00-bd39686d861d None admin] PATH_INFO: `/v3/users/0e79567de29645659686e7a653cc6112` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.602528 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 53/106] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Jul 26 10:13:07 2022] POST /identity/v3/projects => generated 302 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:07.603968 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac36733-ee2b-4cfe-9234-eadcdb7a28f7 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.604328 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac36733-ee2b-4cfe-9234-eadcdb7a28f7 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.604785 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac36733-ee2b-4cfe-9234-eadcdb7a28f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.605315 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62f9d9-e399-490f-bb00-bd39686d861d None admin] RBAC: Authorizing `identity:get_user(user_id=0e79567de29645659686e7a653cc6112)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:07.607230 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62f9d9-e399-490f-bb00-bd39686d861d None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:07.610141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 54/107] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:07 2022] GET /identity/v3/users/0e79567de29645659686e7a653cc6112 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:07.619623 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62f9d9-e399-490f-bb00-bd39686d861d None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:07.648808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-8ac36733-ee2b-4cfe-9234-eadcdb7a28f7 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:07.649583 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-8ac36733-ee2b-4cfe-9234-eadcdb7a28f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:07.737669 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62f9d9-e399-490f-bb00-bd39686d861d None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:07.770905 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:07.797710 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4a59-1638-4687-8553-a804a6736ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:07.798404 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4a59-1638-4687-8553-a804a6736ffc None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.798711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4a59-1638-4687-8553-a804a6736ffc None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.798979 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4a59-1638-4687-8553-a804a6736ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.909751 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4a59-1638-4687-8553-a804a6736ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:07.911216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4a59-1638-4687-8553-a804a6736ffc None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:07.936993 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 54/108] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:07.976414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097b797-ea7d-4bfd-b290-50a34ab04c0e None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.976758 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097b797-ea7d-4bfd-b290-50a34ab04c0e None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.976984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097b797-ea7d-4bfd-b290-50a34ab04c0e None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.978704 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 55/109] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:07.979371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097b797-ea7d-4bfd-b290-50a34ab04c0e None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.005791 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:08.048276 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 55/110] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:08.049872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf0b9d-d9fb-4c9b-a658-51b6bbeee7a0 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.050327 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf0b9d-d9fb-4c9b-a658-51b6bbeee7a0 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.051620 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf0b9d-d9fb-4c9b-a658-51b6bbeee7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.072279 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-1cbf0b9d-d9fb-4c9b-a658-51b6bbeee7a0 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:08.073899 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-1cbf0b9d-d9fb-4c9b-a658-51b6bbeee7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:08.082788 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:08.129263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097b797-ea7d-4bfd-b290-50a34ab04c0e None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.147373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 56/111] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:08.148606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf0b9d-d9fb-4c9b-a658-51b6bbeee7a0 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.167078 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b164ee1-2769-4c32-88bf-ee872b426e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:08.167767 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b164ee1-2769-4c32-88bf-ee872b426e2b None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.168001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b164ee1-2769-4c32-88bf-ee872b426e2b None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.168279 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b164ee1-2769-4c32-88bf-ee872b426e2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.181954 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b164ee1-2769-4c32-88bf-ee872b426e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-5b164ee1-2769-4c32-88bf-ee872b426e2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:08.187833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:08.188797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:08.189534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:08.189534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:08.189534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:08.189534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:08.189534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:08.189534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:08.189534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:08.189534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:08.189534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:08.189534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:08.189534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:08.189534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:08.190218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 56/112] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:08.191878 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6d84d-a688-48c0-8e34-2177e16279a4 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.191878 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6d84d-a688-48c0-8e34-2177e16279a4 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.192062 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6d84d-a688-48c0-8e34-2177e16279a4 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.194312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 57/113] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:08.197701 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6d84d-a688-48c0-8e34-2177e16279a4 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.273328 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:08.279927 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf0b9d-d9fb-4c9b-a658-51b6bbeee7a0 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.313157 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6d84d-a688-48c0-8e34-2177e16279a4 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.320519 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea05dee-507c-4022-87cd-0c03eb75747c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:08.321507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea05dee-507c-4022-87cd-0c03eb75747c None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.322057 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea05dee-507c-4022-87cd-0c03eb75747c None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.322581 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea05dee-507c-4022-87cd-0c03eb75747c None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.324069 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea05dee-507c-4022-87cd-0c03eb75747c None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:08.325877 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea05dee-507c-4022-87cd-0c03eb75747c None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:08.328403 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 57/114] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:08 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:08.335003 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763d9a3-fa3c-4789-98ad-b5998e94d7fe None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.335659 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763d9a3-fa3c-4789-98ad-b5998e94d7fe None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.336117 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763d9a3-fa3c-4789-98ad-b5998e94d7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.352228 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28022387-42ea-4da9-ae2b-e5b54887183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:08.353091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28022387-42ea-4da9-ae2b-e5b54887183c None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.353395 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28022387-42ea-4da9-ae2b-e5b54887183c None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.353789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28022387-42ea-4da9-ae2b-e5b54887183c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.358038 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-2763d9a3-fa3c-4789-98ad-b5998e94d7fe None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:08.359814 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-2763d9a3-fa3c-4789-98ad-b5998e94d7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:08.363793 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:08.369134 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28022387-42ea-4da9-ae2b-e5b54887183c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-28022387-42ea-4da9-ae2b-e5b54887183c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:08.377694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:08.378846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:08.379730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:08.379730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:08.379730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:08.379730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:08.379730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:08.379730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:08.379730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:08.379730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:08.379730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:08.379730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:08.379730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:08.379730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:08.379730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 58/115] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:08.380348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28022387-42ea-4da9-ae2b-e5b54887183c None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.454710 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 58/116] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:08.456695 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763d9a3-fa3c-4789-98ad-b5998e94d7fe None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.502846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28022387-42ea-4da9-ae2b-e5b54887183c None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.534646 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:08.548333 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a8a64-ead1-447b-844e-d3ad80dc9b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:08.549050 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a8a64-ead1-447b-844e-d3ad80dc9b40 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.549390 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a8a64-ead1-447b-844e-d3ad80dc9b40 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.549671 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a8a64-ead1-447b-844e-d3ad80dc9b40 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.550399 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a8a64-ead1-447b-844e-d3ad80dc9b40 None admin] RBAC: Adding query filter params (name=member) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:08.550748 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a8a64-ead1-447b-844e-d3ad80dc9b40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:08.552153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a8a64-ead1-447b-844e-d3ad80dc9b40 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:08.561087 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 59/117] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:08.561976 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a8a64-ead1-447b-844e-d3ad80dc9b40 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.597846 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763d9a3-fa3c-4789-98ad-b5998e94d7fe None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.635925 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c1c5e-35e6-42b4-984a-c86abc76a831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:08.636636 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c1c5e-35e6-42b4-984a-c86abc76a831 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.636963 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c1c5e-35e6-42b4-984a-c86abc76a831 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.637243 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c1c5e-35e6-42b4-984a-c86abc76a831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.638169 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c1c5e-35e6-42b4-984a-c86abc76a831 None admin] RBAC: Adding query filter params (role.id=3d8f099531114c74ad03cc59fe401ee9, scope.project.id=da2d23ccca37438b90e87196aa0fbe36, user.id=0e79567de29645659686e7a653cc6112) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:08.638512 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c1c5e-35e6-42b4-984a-c86abc76a831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:08.640019 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c1c5e-35e6-42b4-984a-c86abc76a831 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:08.654480 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 59/118] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:08 2022] GET /identity/v3/role_assignments?user.id=0e79567de29645659686e7a653cc6112&scope.project.id=da2d23ccca37438b90e87196aa0fbe36&role.id=3d8f099531114c74ad03cc59fe401ee9 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:08.654480 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c1c5e-35e6-42b4-984a-c86abc76a831 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.654480 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:08.699935 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a8a64-ead1-447b-844e-d3ad80dc9b40 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.751595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b59022-89bd-4e3e-a518-d2a37ea6bdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:08.752423 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b59022-89bd-4e3e-a518-d2a37ea6bdb3 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.752707 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b59022-89bd-4e3e-a518-d2a37ea6bdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.753454 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b59022-89bd-4e3e-a518-d2a37ea6bdb3 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.754268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b59022-89bd-4e3e-a518-d2a37ea6bdb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:08.754605 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b59022-89bd-4e3e-a518-d2a37ea6bdb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:08.756054 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b59022-89bd-4e3e-a518-d2a37ea6bdb3 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:08.769735 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 60/119] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:08.771093 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56163041-1b48-49f2-94d2-7990449e00c5 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.771379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56163041-1b48-49f2-94d2-7990449e00c5 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.771649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56163041-1b48-49f2-94d2-7990449e00c5 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.775052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c1c5e-35e6-42b4-984a-c86abc76a831 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.777470 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 61/120] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:08.779116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56163041-1b48-49f2-94d2-7990449e00c5 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.816400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a977299-b9ec-4a2b-9549-12c347fc1da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:08.817122 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a977299-b9ec-4a2b-9549-12c347fc1da2 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.817412 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a977299-b9ec-4a2b-9549-12c347fc1da2 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.817688 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a977299-b9ec-4a2b-9549-12c347fc1da2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.830488 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a977299-b9ec-4a2b-9549-12c347fc1da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-4a977299-b9ec-4a2b-9549-12c347fc1da2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:08.836377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:08.837292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:08.838033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:08.838033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:08.838033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:08.838033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:08.838033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:08.838033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:08.838033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:08.838033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:08.838033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:08.838033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:08.838033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:08.838033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:08.838033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 60/121] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:08.838702 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a977299-b9ec-4a2b-9549-12c347fc1da2 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.857283 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:08.917998 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:08.924756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56163041-1b48-49f2-94d2-7990449e00c5 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.968396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a977299-b9ec-4a2b-9549-12c347fc1da2 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.969587 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265563cb-abe2-4562-a776-786848f2c0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:08.971653 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265563cb-abe2-4562-a776-786848f2c0b2 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.972092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265563cb-abe2-4562-a776-786848f2c0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.972509 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265563cb-abe2-4562-a776-786848f2c0b2 None admin] PATH_INFO: `/v3/users/2ea2941f7ce84e2c852c62634e0e040a` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.973833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265563cb-abe2-4562-a776-786848f2c0b2 None admin] RBAC: Authorizing `identity:get_user(user_id=2ea2941f7ce84e2c852c62634e0e040a)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:08.975463 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265563cb-abe2-4562-a776-786848f2c0b2 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:08.978412 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 62/122] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:08 2022] GET /identity/v3/users/2ea2941f7ce84e2c852c62634e0e040a => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:08.979766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3f015-9ad5-4324-a59e-eddb8980d72b None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.980193 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3f015-9ad5-4324-a59e-eddb8980d72b None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.980599 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3f015-9ad5-4324-a59e-eddb8980d72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:09.005170 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-5ef3f015-9ad5-4324-a59e-eddb8980d72b None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:09.007250 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-5ef3f015-9ad5-4324-a59e-eddb8980d72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:09.013162 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005caae-e63f-4d49-bcbc-3ff1ae1342bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:09.013931 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005caae-e63f-4d49-bcbc-3ff1ae1342bb None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:09.014220 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005caae-e63f-4d49-bcbc-3ff1ae1342bb None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:09.014531 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005caae-e63f-4d49-bcbc-3ff1ae1342bb None admin] PATH_INFO: `/v3/users/2ea2941f7ce84e2c852c62634e0e040a` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:09.015833 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005caae-e63f-4d49-bcbc-3ff1ae1342bb None admin] RBAC: Authorizing `identity:get_user(user_id=2ea2941f7ce84e2c852c62634e0e040a)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:09.019808 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005caae-e63f-4d49-bcbc-3ff1ae1342bb None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:09.026867 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 61/123] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:08 2022] GET /identity/v3/users/2ea2941f7ce84e2c852c62634e0e040a => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:09.027815 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005caae-e63f-4d49-bcbc-3ff1ae1342bb None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:09.101760 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 63/124] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:09.102939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3f015-9ad5-4324-a59e-eddb8980d72b None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:09.167473 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005caae-e63f-4d49-bcbc-3ff1ae1342bb None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:09.173573 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:09.217864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:09.226296 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179349e-0795-4502-99a0-a58799d217e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:09.227217 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179349e-0795-4502-99a0-a58799d217e4 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:09.227636 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179349e-0795-4502-99a0-a58799d217e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:09.228046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179349e-0795-4502-99a0-a58799d217e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:09.229579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179349e-0795-4502-99a0-a58799d217e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:09.230099 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179349e-0795-4502-99a0-a58799d217e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:09.232048 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179349e-0795-4502-99a0-a58799d217e4 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:09.243914 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3f015-9ad5-4324-a59e-eddb8980d72b None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:09.244554 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 62/125] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:09.245770 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179349e-0795-4502-99a0-a58799d217e4 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:09.295239 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05153ac1-c4f7-4f21-882f-c8fba054ddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:09.295941 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05153ac1-c4f7-4f21-882f-c8fba054ddee None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:09.296266 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05153ac1-c4f7-4f21-882f-c8fba054ddee None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:09.296545 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05153ac1-c4f7-4f21-882f-c8fba054ddee None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:09.297739 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05153ac1-c4f7-4f21-882f-c8fba054ddee None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:09.299351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05153ac1-c4f7-4f21-882f-c8fba054ddee None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:09.301224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 64/126] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:09 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:09.301915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05153ac1-c4f7-4f21-882f-c8fba054ddee None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:09.409372 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179349e-0795-4502-99a0-a58799d217e4 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:09.422369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05153ac1-c4f7-4f21-882f-c8fba054ddee None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:09.446778 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:09.446978 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cdb4a-e8de-44be-915c-df90efb06363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:09.448113 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cdb4a-e8de-44be-915c-df90efb06363 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:09.448523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cdb4a-e8de-44be-915c-df90efb06363 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:09.448935 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cdb4a-e8de-44be-915c-df90efb06363 None admin] PATH_INFO: `/v3/projects/c62a83be94084167974e9ec84f6f7149` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:09.450259 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cdb4a-e8de-44be-915c-df90efb06363 None admin] RBAC: Authorizing `identity:get_project(project_id=c62a83be94084167974e9ec84f6f7149)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:09.451928 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cdb4a-e8de-44be-915c-df90efb06363 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:09.458855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 63/127] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:09 2022] GET /identity/v3/projects/c62a83be94084167974e9ec84f6f7149 => generated 312 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:09.459721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cdb4a-e8de-44be-915c-df90efb06363 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:09.470138 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb50b5-b535-4474-b12b-5dac6759030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:09.471069 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb50b5-b535-4474-b12b-5dac6759030e None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:09.471520 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb50b5-b535-4474-b12b-5dac6759030e None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:09.472383 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb50b5-b535-4474-b12b-5dac6759030e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:09.487792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb50b5-b535-4474-b12b-5dac6759030e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-12eb50b5-b535-4474-b12b-5dac6759030e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:09.495923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:09.496998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:09.498024 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:09.498024 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:09.498024 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:09.498024 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:09.498024 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:09.498024 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:09.498024 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:09.498024 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:09.498024 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:09.498024 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:09.498024 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:09.498024 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:09.501390 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 65/128] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:09.506934 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb50b5-b535-4474-b12b-5dac6759030e None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:09.530033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:09.582644 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cdb4a-e8de-44be-915c-df90efb06363 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:09.626110 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb50b5-b535-4474-b12b-5dac6759030e None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:09.631936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684b5a7-b439-4f06-8b3a-a1aecccc497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:09.632853 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684b5a7-b439-4f06-8b3a-a1aecccc497c None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:09.633817 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684b5a7-b439-4f06-8b3a-a1aecccc497c None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:09.634313 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684b5a7-b439-4f06-8b3a-a1aecccc497c None admin] PATH_INFO: `/v3/users/a7aff02dbe9d4c34ad6d286018218135` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:09.636159 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684b5a7-b439-4f06-8b3a-a1aecccc497c None admin] RBAC: Authorizing `identity:get_user(user_id=a7aff02dbe9d4c34ad6d286018218135)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:09.638941 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684b5a7-b439-4f06-8b3a-a1aecccc497c None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:09.641895 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 64/129] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:09 2022] GET /identity/v3/users/a7aff02dbe9d4c34ad6d286018218135 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:09.642886 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684b5a7-b439-4f06-8b3a-a1aecccc497c None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:09.672268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986c459-4817-4381-bd74-7be60d7328e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:09.673488 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986c459-4817-4381-bd74-7be60d7328e8 None admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:09.674169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986c459-4817-4381-bd74-7be60d7328e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:09.674683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986c459-4817-4381-bd74-7be60d7328e8 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36/users/2ea2941f7ce84e2c852c62634e0e040a/roles/c483c855d04b4145a203e1f0eedf3c0c` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:09.677778 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986c459-4817-4381-bd74-7be60d7328e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=da2d23ccca37438b90e87196aa0fbe36, user_id=2ea2941f7ce84e2c852c62634e0e040a, role_id=c483c855d04b4145a203e1f0eedf3c0c)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:09.680132 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986c459-4817-4381-bd74-7be60d7328e8 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:09.706576 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 66/130] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:13:09 2022] PUT /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36/users/2ea2941f7ce84e2c852c62634e0e040a/roles/c483c855d04b4145a203e1f0eedf3c0c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:09.707847 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986c459-4817-4381-bd74-7be60d7328e8 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:09.776806 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684b5a7-b439-4f06-8b3a-a1aecccc497c None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:09.794957 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:09.822857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:09.832410 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a2c91-327f-4896-82a5-8c338d1078b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:09.833597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a2c91-327f-4896-82a5-8c338d1078b2 None admin] REQUEST_METHOD: `PUT` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:09.834072 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a2c91-327f-4896-82a5-8c338d1078b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:09.834849 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a2c91-327f-4896-82a5-8c338d1078b2 None admin] PATH_INFO: `/v3/projects/c62a83be94084167974e9ec84f6f7149/users/2ea2941f7ce84e2c852c62634e0e040a/roles/c483c855d04b4145a203e1f0eedf3c0c` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:09.837944 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a2c91-327f-4896-82a5-8c338d1078b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c62a83be94084167974e9ec84f6f7149, user_id=2ea2941f7ce84e2c852c62634e0e040a, role_id=c483c855d04b4145a203e1f0eedf3c0c)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:09.839928 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a2c91-327f-4896-82a5-8c338d1078b2 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:09.861388 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 65/131] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:13:09 2022] PUT /identity/v3/projects/c62a83be94084167974e9ec84f6f7149/users/2ea2941f7ce84e2c852c62634e0e040a/roles/c483c855d04b4145a203e1f0eedf3c0c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:09.863328 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a2c91-327f-4896-82a5-8c338d1078b2 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:09.981578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986c459-4817-4381-bd74-7be60d7328e8 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.002773 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a2c91-327f-4896-82a5-8c338d1078b2 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.049534 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da001bcb-75c3-46ab-8aad-b375e8463abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.051018 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da001bcb-75c3-46ab-8aad-b375e8463abf None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.051911 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da001bcb-75c3-46ab-8aad-b375e8463abf None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.052673 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da001bcb-75c3-46ab-8aad-b375e8463abf None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.054547 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da001bcb-75c3-46ab-8aad-b375e8463abf None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:10.056444 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db164120-537c-4024-9566-50fe429735a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.056820 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da001bcb-75c3-46ab-8aad-b375e8463abf None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:10.057235 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db164120-537c-4024-9566-50fe429735a0 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.057587 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db164120-537c-4024-9566-50fe429735a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.057935 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db164120-537c-4024-9566-50fe429735a0 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.058791 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db164120-537c-4024-9566-50fe429735a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:10.059166 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db164120-537c-4024-9566-50fe429735a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:10.060025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 66/132] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:09 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:10.060744 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db164120-537c-4024-9566-50fe429735a0 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:10.069107 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da001bcb-75c3-46ab-8aad-b375e8463abf None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:10.076283 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 67/133] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:10.082158 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db164120-537c-4024-9566-50fe429735a0 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:10.147793 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:10.195955 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da001bcb-75c3-46ab-8aad-b375e8463abf None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.221097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:10.227402 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db164120-537c-4024-9566-50fe429735a0 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.245510 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe4ec7-ba89-42ea-a864-054badefc40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.246219 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe4ec7-ba89-42ea-a864-054badefc40b None admin] REQUEST_METHOD: `PUT` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.246526 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe4ec7-ba89-42ea-a864-054badefc40b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.246809 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe4ec7-ba89-42ea-a864-054badefc40b None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36/users/a7aff02dbe9d4c34ad6d286018218135/roles/7d88b748366a42929784db05d53fe473` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.252476 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe4ec7-ba89-42ea-a864-054badefc40b None admin] RBAC: Authorizing `identity:create_grant(project_id=da2d23ccca37438b90e87196aa0fbe36, user_id=a7aff02dbe9d4c34ad6d286018218135, role_id=7d88b748366a42929784db05d53fe473)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:10.253974 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe4ec7-ba89-42ea-a864-054badefc40b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:10.278055 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 67/134] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:13:10 2022] PUT /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36/users/a7aff02dbe9d4c34ad6d286018218135/roles/7d88b748366a42929784db05d53fe473 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 10:13:10.286553 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa77f62-52f1-46b5-8b63-bdbf806598ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.287402 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa77f62-52f1-46b5-8b63-bdbf806598ce None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.287696 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa77f62-52f1-46b5-8b63-bdbf806598ce None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.287980 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa77f62-52f1-46b5-8b63-bdbf806598ce None admin] PATH_INFO: `/v3/users/2ea2941f7ce84e2c852c62634e0e040a` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.289531 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa77f62-52f1-46b5-8b63-bdbf806598ce None admin] RBAC: Authorizing `identity:get_user(user_id=2ea2941f7ce84e2c852c62634e0e040a)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:10.291796 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa77f62-52f1-46b5-8b63-bdbf806598ce None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:10.294158 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 68/135] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:10 2022] GET /identity/v3/users/2ea2941f7ce84e2c852c62634e0e040a => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:10.300708 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe4ec7-ba89-42ea-a864-054badefc40b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:10.459821 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe4ec7-ba89-42ea-a864-054badefc40b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.487709 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:10.513449 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5e3f0-578e-4426-aec1-24ba4f68efb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.514392 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5e3f0-578e-4426-aec1-24ba4f68efb1 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.514986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5e3f0-578e-4426-aec1-24ba4f68efb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.515406 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5e3f0-578e-4426-aec1-24ba4f68efb1 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.519233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5e3f0-578e-4426-aec1-24ba4f68efb1 None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:10.520918 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5e3f0-578e-4426-aec1-24ba4f68efb1 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:10.522873 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 68/136] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:10 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:10.529003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa77f62-52f1-46b5-8b63-bdbf806598ce None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:10.601640 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fc9e7-033d-40ef-83aa-72cef7990fd2 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.602207 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fc9e7-033d-40ef-83aa-72cef7990fd2 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.603375 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fc9e7-033d-40ef-83aa-72cef7990fd2 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.605457 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 69/137] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:10.612202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3558df-6cde-451a-ad75-84b36a33049f None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.612506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3558df-6cde-451a-ad75-84b36a33049f None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.612765 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3558df-6cde-451a-ad75-84b36a33049f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.652011 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-ea3558df-6cde-451a-ad75-84b36a33049f None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:10.653613 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-ea3558df-6cde-451a-ad75-84b36a33049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:10.691034 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa77f62-52f1-46b5-8b63-bdbf806598ce None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.756726 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af977c3a-2e18-475e-b119-f50737d5da13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.757361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af977c3a-2e18-475e-b119-f50737d5da13 None admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.757605 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af977c3a-2e18-475e-b119-f50737d5da13 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.757887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af977c3a-2e18-475e-b119-f50737d5da13 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36/users/2ea2941f7ce84e2c852c62634e0e040a/roles/2ae24c72c8264d0ba34cbe573083cc33` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.762503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af977c3a-2e18-475e-b119-f50737d5da13 None admin] RBAC: Authorizing `identity:create_grant(project_id=da2d23ccca37438b90e87196aa0fbe36, user_id=2ea2941f7ce84e2c852c62634e0e040a, role_id=2ae24c72c8264d0ba34cbe573083cc33)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:10.764005 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af977c3a-2e18-475e-b119-f50737d5da13 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:10.785553 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 70/138] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 26 10:13:10.785927 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 69/139] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:13:10 2022] PUT /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36/users/2ea2941f7ce84e2c852c62634e0e040a/roles/2ae24c72c8264d0ba34cbe573083cc33 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:10.817313 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3558df-6cde-451a-ad75-84b36a33049f None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:10.943819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3558df-6cde-451a-ad75-84b36a33049f None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.974965 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:10.996551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a6be7-007d-4f5d-ba2f-ff7ca6def196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.997282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a6be7-007d-4f5d-ba2f-ff7ca6def196 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.997569 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a6be7-007d-4f5d-ba2f-ff7ca6def196 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.998084 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a6be7-007d-4f5d-ba2f-ff7ca6def196 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.999567 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a6be7-007d-4f5d-ba2f-ff7ca6def196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:11.001216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a6be7-007d-4f5d-ba2f-ff7ca6def196 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:11.003240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 71/140] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:11.013545 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af977c3a-2e18-475e-b119-f50737d5da13 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:11.055708 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:11.141082 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af977c3a-2e18-475e-b119-f50737d5da13 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:11.191162 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf072a41-3bd3-4e92-86ad-6042c61235d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:11.192210 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf072a41-3bd3-4e92-86ad-6042c61235d1 None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.192696 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf072a41-3bd3-4e92-86ad-6042c61235d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.193166 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf072a41-3bd3-4e92-86ad-6042c61235d1 None admin] PATH_INFO: `/v3/users` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.194081 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf072a41-3bd3-4e92-86ad-6042c61235d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:11.195787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf072a41-3bd3-4e92-86ad-6042c61235d1 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:11.229052 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 70/141] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Jul 26 10:13:11 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:11.666640 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a12b7-2010-432f-bca5-6fc945877b00 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.667327 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a12b7-2010-432f-bca5-6fc945877b00 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.667327 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a12b7-2010-432f-bca5-6fc945877b00 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.668858 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 72/142] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:11.674947 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef554658-2c31-4f8e-ac0d-6aad70015307 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.675290 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef554658-2c31-4f8e-ac0d-6aad70015307 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.675514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef554658-2c31-4f8e-ac0d-6aad70015307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.696359 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-ef554658-2c31-4f8e-ac0d-6aad70015307 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:11.697641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-ef554658-2c31-4f8e-ac0d-6aad70015307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:11.777597 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 71/143] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:11.818025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a12b7-2010-432f-bca5-6fc945877b00 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:11.945255 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a12b7-2010-432f-bca5-6fc945877b00 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:11.984240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94c16f-c8e1-4d47-b36b-6e86be815d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:11.984896 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94c16f-c8e1-4d47-b36b-6e86be815d98 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.985215 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94c16f-c8e1-4d47-b36b-6e86be815d98 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.985459 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94c16f-c8e1-4d47-b36b-6e86be815d98 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.996563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94c16f-c8e1-4d47-b36b-6e86be815d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-1e94c16f-c8e1-4d47-b36b-6e86be815d98 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:12.001772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:12.002684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:12.003926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:12.003926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:12.003926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:12.003926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:12.003926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:12.003926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:12.003926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:12.003926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:12.003926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:12.003926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:12.003926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:12.003926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:12.003926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 73/144] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:12.013664 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef554658-2c31-4f8e-ac0d-6aad70015307 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:12.043693 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:12.167532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef554658-2c31-4f8e-ac0d-6aad70015307 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:12.223285 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133bb5c-e664-4855-a640-0a96f69a9cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:12.223863 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133bb5c-e664-4855-a640-0a96f69a9cdb None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:12.224150 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133bb5c-e664-4855-a640-0a96f69a9cdb None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:12.224446 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133bb5c-e664-4855-a640-0a96f69a9cdb None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:12.225192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133bb5c-e664-4855-a640-0a96f69a9cdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:12.225499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133bb5c-e664-4855-a640-0a96f69a9cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:12.226942 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133bb5c-e664-4855-a640-0a96f69a9cdb None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:12.236203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 72/145] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:12.242036 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94c16f-c8e1-4d47-b36b-6e86be815d98 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:12.313902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:12.440948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94c16f-c8e1-4d47-b36b-6e86be815d98 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:12.488168 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c447341-feae-4371-bd0b-a68948ff528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:12.488751 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c447341-feae-4371-bd0b-a68948ff528b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:12.489033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c447341-feae-4371-bd0b-a68948ff528b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:12.489309 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c447341-feae-4371-bd0b-a68948ff528b None admin] PATH_INFO: `/v3/users/0e79567de29645659686e7a653cc6112` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:12.490552 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c447341-feae-4371-bd0b-a68948ff528b None admin] RBAC: Authorizing `identity:get_user(user_id=0e79567de29645659686e7a653cc6112)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:12.492029 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c447341-feae-4371-bd0b-a68948ff528b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:12.493980 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 74/146] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:12 2022] GET /identity/v3/users/0e79567de29645659686e7a653cc6112 => generated 289 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:12.499579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133bb5c-e664-4855-a640-0a96f69a9cdb None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:12.628513 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:12.656345 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133bb5c-e664-4855-a640-0a96f69a9cdb None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:12.698606 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce94a6d-7d0a-4f59-a9f0-7b803ccc5797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:12.699282 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce94a6d-7d0a-4f59-a9f0-7b803ccc5797 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:12.699564 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce94a6d-7d0a-4f59-a9f0-7b803ccc5797 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:12.699841 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce94a6d-7d0a-4f59-a9f0-7b803ccc5797 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:12.701085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce94a6d-7d0a-4f59-a9f0-7b803ccc5797 None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:12.702701 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce94a6d-7d0a-4f59-a9f0-7b803ccc5797 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:12.704492 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 73/147] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:12 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:12.710550 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c447341-feae-4371-bd0b-a68948ff528b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:12.912255 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c447341-feae-4371-bd0b-a68948ff528b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:12.929612 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:12.958473 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba732f5-781d-423b-af29-713a60a7ecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:12.959213 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba732f5-781d-423b-af29-713a60a7ecdd None admin] REQUEST_METHOD: `PUT` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:12.959507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba732f5-781d-423b-af29-713a60a7ecdd None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:12.959784 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba732f5-781d-423b-af29-713a60a7ecdd None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36/users/0e79567de29645659686e7a653cc6112/roles/3d8f099531114c74ad03cc59fe401ee9` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:12.962101 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba732f5-781d-423b-af29-713a60a7ecdd None admin] RBAC: Authorizing `identity:create_grant(project_id=da2d23ccca37438b90e87196aa0fbe36, user_id=0e79567de29645659686e7a653cc6112, role_id=3d8f099531114c74ad03cc59fe401ee9)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:12.963619 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba732f5-781d-423b-af29-713a60a7ecdd None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:12.986799 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 75/148] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:13:12 2022] PUT /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36/users/0e79567de29645659686e7a653cc6112/roles/3d8f099531114c74ad03cc59fe401ee9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:13.236665 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187af05-36c1-4b30-a354-7aded8290ea6 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:13.237639 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187af05-36c1-4b30-a354-7aded8290ea6 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:13.238107 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187af05-36c1-4b30-a354-7aded8290ea6 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:13.239720 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 74/149] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:13.246223 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f66d-7555-49b1-b6f6-394ccd7c5bae None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:13.246824 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f66d-7555-49b1-b6f6-394ccd7c5bae None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:13.247313 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f66d-7555-49b1-b6f6-394ccd7c5bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:13.275482 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-4902f66d-7555-49b1-b6f6-394ccd7c5bae None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:13.277037 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-4902f66d-7555-49b1-b6f6-394ccd7c5bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:13.358646 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 76/150] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:13.384221 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187af05-36c1-4b30-a354-7aded8290ea6 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:13.519848 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187af05-36c1-4b30-a354-7aded8290ea6 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:13.568538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac577d-f12b-4438-8f78-02a0a4f80ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:13.569581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac577d-f12b-4438-8f78-02a0a4f80ed1 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:13.570058 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac577d-f12b-4438-8f78-02a0a4f80ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:13.570574 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac577d-f12b-4438-8f78-02a0a4f80ed1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:13.587484 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac577d-f12b-4438-8f78-02a0a4f80ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-6bac577d-f12b-4438-8f78-02a0a4f80ed1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:13.592930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:13.593804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:13.594598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:13.594598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:13.594598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:13.594598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:13.594598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:13.594598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:13.594598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:13.594598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:13.594598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:13.594598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:13.594598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:13.594598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:13.597012 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 75/151] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:13.603393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902f66d-7555-49b1-b6f6-394ccd7c5bae None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:13.725538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902f66d-7555-49b1-b6f6-394ccd7c5bae None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:13.728243 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:13.770032 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58a516-0b86-434e-ae08-15fcc7ac8cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:13.770610 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58a516-0b86-434e-ae08-15fcc7ac8cc1 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:13.770888 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58a516-0b86-434e-ae08-15fcc7ac8cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:13.771157 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58a516-0b86-434e-ae08-15fcc7ac8cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:13.771896 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58a516-0b86-434e-ae08-15fcc7ac8cc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:13.772200 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58a516-0b86-434e-ae08-15fcc7ac8cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:13.773589 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58a516-0b86-434e-ae08-15fcc7ac8cc1 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:13.788368 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 77/152] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:13.794714 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac577d-f12b-4438-8f78-02a0a4f80ed1 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:13.799360 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:13.933173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac577d-f12b-4438-8f78-02a0a4f80ed1 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:13.979331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29bd8c-fcb9-4e34-a74f-64b034250b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:13.980026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29bd8c-fcb9-4e34-a74f-64b034250b19 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:13.980308 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29bd8c-fcb9-4e34-a74f-64b034250b19 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:13.980583 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29bd8c-fcb9-4e34-a74f-64b034250b19 None admin] PATH_INFO: `/v3/users/2ea2941f7ce84e2c852c62634e0e040a` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:13.981942 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29bd8c-fcb9-4e34-a74f-64b034250b19 None admin] RBAC: Authorizing `identity:get_user(user_id=2ea2941f7ce84e2c852c62634e0e040a)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:13.983512 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29bd8c-fcb9-4e34-a74f-64b034250b19 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:13.985197 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 76/153] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:13 2022] GET /identity/v3/users/2ea2941f7ce84e2c852c62634e0e040a => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:13.991057 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58a516-0b86-434e-ae08-15fcc7ac8cc1 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:14.093523 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a277b-efd7-4c1a-b5e4-82c980b06208 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.093714 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a277b-efd7-4c1a-b5e4-82c980b06208 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.093964 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a277b-efd7-4c1a-b5e4-82c980b06208 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.095369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 77/154] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:14.112460 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115e7eb-7be3-4a3d-8a27-bb8743e3452c None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.112763 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115e7eb-7be3-4a3d-8a27-bb8743e3452c None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.113010 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115e7eb-7be3-4a3d-8a27-bb8743e3452c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.143610 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-a115e7eb-7be3-4a3d-8a27-bb8743e3452c None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:14.145211 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-a115e7eb-7be3-4a3d-8a27-bb8743e3452c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:14.161307 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58a516-0b86-434e-ae08-15fcc7ac8cc1 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:14.251232 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311d3fd-3763-4b6d-b3dc-308a7bd816f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:14.251876 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311d3fd-3763-4b6d-b3dc-308a7bd816f7 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.252162 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311d3fd-3763-4b6d-b3dc-308a7bd816f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.252433 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311d3fd-3763-4b6d-b3dc-308a7bd816f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.307198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 78/155] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:14.309391 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e33f6-e473-437d-9db7-d92fb43439b0 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.309891 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e33f6-e473-437d-9db7-d92fb43439b0 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.310365 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e33f6-e473-437d-9db7-d92fb43439b0 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.311918 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 79/156] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:14.317551 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cb599-db59-4d51-b9da-2100bb8b78fc None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.318075 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cb599-db59-4d51-b9da-2100bb8b78fc None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.318610 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cb599-db59-4d51-b9da-2100bb8b78fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.334811 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:14.354245 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:14.356336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-b33cb599-db59-4d51-b9da-2100bb8b78fc None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:14.357859 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-b33cb599-db59-4d51-b9da-2100bb8b78fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:14.444315 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311d3fd-3763-4b6d-b3dc-308a7bd816f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:14.451215 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311d3fd-3763-4b6d-b3dc-308a7bd816f7 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:14.561057 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 80/157] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:14.562751 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cb599-db59-4d51-b9da-2100bb8b78fc None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:14.615277 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 78/158] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:14.622083 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311d3fd-3763-4b6d-b3dc-308a7bd816f7 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:14.730476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cb599-db59-4d51-b9da-2100bb8b78fc None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:14.757202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:14.798606 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:14.807991 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e781c-a872-4841-9c41-4517aaa0cbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:14.808983 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e781c-a872-4841-9c41-4517aaa0cbf7 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.809457 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e781c-a872-4841-9c41-4517aaa0cbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.809921 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e781c-a872-4841-9c41-4517aaa0cbf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.827952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e781c-a872-4841-9c41-4517aaa0cbf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-cc1e781c-a872-4841-9c41-4517aaa0cbf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:14.832939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:14.833910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:14.834770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:14.834770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:14.834770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:14.834770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:14.834770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:14.834770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:14.834770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:14.834770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:14.834770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:14.834770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:14.834770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:14.834770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:14.834770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 81/159] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:14.839832 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311d3fd-3763-4b6d-b3dc-308a7bd816f7 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:14.841662 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e781c-a872-4841-9c41-4517aaa0cbf7 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:14.908596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76568746-8bfa-40c3-80f0-d1b629370d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:14.909261 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76568746-8bfa-40c3-80f0-d1b629370d7a None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.909539 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76568746-8bfa-40c3-80f0-d1b629370d7a None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.909833 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76568746-8bfa-40c3-80f0-d1b629370d7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.935084 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76568746-8bfa-40c3-80f0-d1b629370d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-76568746-8bfa-40c3-80f0-d1b629370d7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:14.940353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:14.941305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:14.942087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:14.942087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:14.942087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:14.942087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:14.942087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:14.942087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:14.942087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:14.942087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:14.942087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:14.942087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:14.942087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:14.942087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:14.942087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 79/160] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:14.947934 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905acdbe-af59-4099-b651-1d3f29f01f8d None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.948486 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905acdbe-af59-4099-b651-1d3f29f01f8d None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.948486 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905acdbe-af59-4099-b651-1d3f29f01f8d None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.949921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 80/161] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:14.950550 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905acdbe-af59-4099-b651-1d3f29f01f8d None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:15.001113 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e781c-a872-4841-9c41-4517aaa0cbf7 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.061547 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8db48-d9e7-4965-baf8-82d47259b182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:15.062209 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8db48-d9e7-4965-baf8-82d47259b182 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.062510 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8db48-d9e7-4965-baf8-82d47259b182 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.062788 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8db48-d9e7-4965-baf8-82d47259b182 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.063985 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8db48-d9e7-4965-baf8-82d47259b182 None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:15.065482 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8db48-d9e7-4965-baf8-82d47259b182 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:15.067401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 82/162] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:14 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:15.072638 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8db48-d9e7-4965-baf8-82d47259b182 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:15.119994 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905acdbe-af59-4099-b651-1d3f29f01f8d None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.162964 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:15.194943 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d12f88-618d-4ca0-a2d2-760f32a1deab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:15.195595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d12f88-618d-4ca0-a2d2-760f32a1deab None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.195873 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d12f88-618d-4ca0-a2d2-760f32a1deab None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.196144 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d12f88-618d-4ca0-a2d2-760f32a1deab None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.196893 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d12f88-618d-4ca0-a2d2-760f32a1deab None admin] RBAC: Adding query filter params (name=member) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:15.197198 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d12f88-618d-4ca0-a2d2-760f32a1deab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:15.198705 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d12f88-618d-4ca0-a2d2-760f32a1deab None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:15.216702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:15.222540 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 81/163] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:15.223924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54add516-8942-4db7-b50a-4df3fee5b96b None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.224314 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54add516-8942-4db7-b50a-4df3fee5b96b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.224557 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54add516-8942-4db7-b50a-4df3fee5b96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.252388 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-54add516-8942-4db7-b50a-4df3fee5b96b None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:15.253673 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-54add516-8942-4db7-b50a-4df3fee5b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:15.324594 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8db48-d9e7-4965-baf8-82d47259b182 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.363782 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 82/164] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:15.364705 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54add516-8942-4db7-b50a-4df3fee5b96b None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:15.413810 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d629f6-0adc-48de-8c1f-6eaf79f5405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:15.414534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d629f6-0adc-48de-8c1f-6eaf79f5405a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.415015 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d629f6-0adc-48de-8c1f-6eaf79f5405a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.418455 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d629f6-0adc-48de-8c1f-6eaf79f5405a None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.418455 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d629f6-0adc-48de-8c1f-6eaf79f5405a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:15.418455 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d629f6-0adc-48de-8c1f-6eaf79f5405a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:15.418816 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d629f6-0adc-48de-8c1f-6eaf79f5405a None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:15.435840 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 83/165] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:15.437243 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d629f6-0adc-48de-8c1f-6eaf79f5405a None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:15.564694 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54add516-8942-4db7-b50a-4df3fee5b96b None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.602020 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:15.648653 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71151c76-eb72-4081-ad92-ccca2fbe1e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:15.649306 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71151c76-eb72-4081-ad92-ccca2fbe1e51 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.649586 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71151c76-eb72-4081-ad92-ccca2fbe1e51 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.649856 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71151c76-eb72-4081-ad92-ccca2fbe1e51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.650726 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71151c76-eb72-4081-ad92-ccca2fbe1e51 None admin] RBAC: Adding query filter params (role.id=c483c855d04b4145a203e1f0eedf3c0c, scope.project.id=da2d23ccca37438b90e87196aa0fbe36, user.id=2ea2941f7ce84e2c852c62634e0e040a) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:15.651039 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71151c76-eb72-4081-ad92-ccca2fbe1e51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:15.652541 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71151c76-eb72-4081-ad92-ccca2fbe1e51 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:15.666611 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 83/166] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:15 2022] GET /identity/v3/role_assignments?user.id=2ea2941f7ce84e2c852c62634e0e040a&scope.project.id=da2d23ccca37438b90e87196aa0fbe36&role.id=c483c855d04b4145a203e1f0eedf3c0c => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:15.667431 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71151c76-eb72-4081-ad92-ccca2fbe1e51 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:15.671083 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d629f6-0adc-48de-8c1f-6eaf79f5405a None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.707784 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:15.743226 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea0abc-a7fc-45d7-a86c-3ed8383b830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:15.743916 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea0abc-a7fc-45d7-a86c-3ed8383b830a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.744187 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea0abc-a7fc-45d7-a86c-3ed8383b830a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.744450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea0abc-a7fc-45d7-a86c-3ed8383b830a None admin] PATH_INFO: `/v3/users/2ea2941f7ce84e2c852c62634e0e040a` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.745741 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea0abc-a7fc-45d7-a86c-3ed8383b830a None admin] RBAC: Authorizing `identity:get_user(user_id=2ea2941f7ce84e2c852c62634e0e040a)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:15.747257 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea0abc-a7fc-45d7-a86c-3ed8383b830a None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:15.749011 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 84/167] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:15 2022] GET /identity/v3/users/2ea2941f7ce84e2c852c62634e0e040a => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:15.749844 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea0abc-a7fc-45d7-a86c-3ed8383b830a None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:15.893771 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea0abc-a7fc-45d7-a86c-3ed8383b830a None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.929158 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71151c76-eb72-4081-ad92-ccca2fbe1e51 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.939646 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce6c4d-2b8f-4a18-83b4-7895a837bfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:15.940667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce6c4d-2b8f-4a18-83b4-7895a837bfc3 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.941146 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce6c4d-2b8f-4a18-83b4-7895a837bfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.941611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce6c4d-2b8f-4a18-83b4-7895a837bfc3 None admin] PATH_INFO: `/v3/users/a7aff02dbe9d4c34ad6d286018218135` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.950459 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce6c4d-2b8f-4a18-83b4-7895a837bfc3 None admin] RBAC: Authorizing `identity:get_user(user_id=a7aff02dbe9d4c34ad6d286018218135)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:15.950459 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce6c4d-2b8f-4a18-83b4-7895a837bfc3 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:15.950742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 85/168] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:15 2022] GET /identity/v3/users/a7aff02dbe9d4c34ad6d286018218135 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:15.951459 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce6c4d-2b8f-4a18-83b4-7895a837bfc3 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:15.996653 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5ee1d-1659-4007-8860-b70e341c45c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:15.997756 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5ee1d-1659-4007-8860-b70e341c45c4 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.998237 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5ee1d-1659-4007-8860-b70e341c45c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.998736 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5ee1d-1659-4007-8860-b70e341c45c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.025470 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5ee1d-1659-4007-8860-b70e341c45c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-08f5ee1d-1659-4007-8860-b70e341c45c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:16.031711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:16.032614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:16.033424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:16.033424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:16.033424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:16.033424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:16.033424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:16.033424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:16.033424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:16.033424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:16.033424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:16.033424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:16.033424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:16.033424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:16.042215 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 84/169] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:16.043750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5ee1d-1659-4007-8860-b70e341c45c4 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:16.126883 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:16.128194 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:16.179883 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce6c4d-2b8f-4a18-83b4-7895a837bfc3 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:16.216522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679c5c2-0131-44f8-8bd3-dbfc2108bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:16.217170 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679c5c2-0131-44f8-8bd3-dbfc2108bd1f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:16.217451 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679c5c2-0131-44f8-8bd3-dbfc2108bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:16.217801 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679c5c2-0131-44f8-8bd3-dbfc2108bd1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.297006 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679c5c2-0131-44f8-8bd3-dbfc2108bd1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:16.298767 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679c5c2-0131-44f8-8bd3-dbfc2108bd1f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:16.304778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5ee1d-1659-4007-8860-b70e341c45c4 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:16.402854 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:16.407197 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adf9bb-93fa-4b25-a482-dc3237d31794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:16.407853 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adf9bb-93fa-4b25-a482-dc3237d31794 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:16.408133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adf9bb-93fa-4b25-a482-dc3237d31794 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:16.408417 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adf9bb-93fa-4b25-a482-dc3237d31794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.446393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 86/170] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:16.447347 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679c5c2-0131-44f8-8bd3-dbfc2108bd1f None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:16.602740 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679c5c2-0131-44f8-8bd3-dbfc2108bd1f None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:16.619737 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adf9bb-93fa-4b25-a482-dc3237d31794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:16.621270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adf9bb-93fa-4b25-a482-dc3237d31794 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:16.646622 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e04fe4-9040-4c30-b035-990107d70701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:16.647267 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e04fe4-9040-4c30-b035-990107d70701 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:16.647733 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e04fe4-9040-4c30-b035-990107d70701 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:16.648020 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e04fe4-9040-4c30-b035-990107d70701 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.648769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e04fe4-9040-4c30-b035-990107d70701 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:16.649080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e04fe4-9040-4c30-b035-990107d70701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:16.650532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e04fe4-9040-4c30-b035-990107d70701 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:16.662643 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 87/171] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:16.663992 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e04fe4-9040-4c30-b035-990107d70701 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:16.703158 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:16.722836 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:16.785731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e04fe4-9040-4c30-b035-990107d70701 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:16.829294 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b41293-975f-419e-b981-d66425e65b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:16.830247 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b41293-975f-419e-b981-d66425e65b16 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:16.830709 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b41293-975f-419e-b981-d66425e65b16 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:16.831207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b41293-975f-419e-b981-d66425e65b16 None admin] PATH_INFO: `/v3/projects/c62a83be94084167974e9ec84f6f7149` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.832802 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b41293-975f-419e-b981-d66425e65b16 None admin] RBAC: Authorizing `identity:get_project(project_id=c62a83be94084167974e9ec84f6f7149)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:16.834669 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b41293-975f-419e-b981-d66425e65b16 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:16.835257 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 85/172] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 792 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:16.836545 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adf9bb-93fa-4b25-a482-dc3237d31794 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:16.837134 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 88/173] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:16 2022] GET /identity/v3/projects/c62a83be94084167974e9ec84f6f7149 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:16.838766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d1c39-d883-4909-87cf-5de68a0282e9 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:16.839224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d1c39-d883-4909-87cf-5de68a0282e9 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:16.839617 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d1c39-d883-4909-87cf-5de68a0282e9 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.841133 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 89/174] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:16.843169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d1c39-d883-4909-87cf-5de68a0282e9 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:16.988841 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adf9bb-93fa-4b25-a482-dc3237d31794 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:17.025757 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ff16f-775a-469f-a988-5d1c4bd77ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:17.026405 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ff16f-775a-469f-a988-5d1c4bd77ea1 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.026875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ff16f-775a-469f-a988-5d1c4bd77ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.027148 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ff16f-775a-469f-a988-5d1c4bd77ea1 None admin] PATH_INFO: `/v3/users/2ea2941f7ce84e2c852c62634e0e040a` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.028662 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ff16f-775a-469f-a988-5d1c4bd77ea1 None admin] RBAC: Authorizing `identity:get_user(user_id=2ea2941f7ce84e2c852c62634e0e040a)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:17.030153 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ff16f-775a-469f-a988-5d1c4bd77ea1 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:17.031901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 86/175] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:16 2022] GET /identity/v3/users/2ea2941f7ce84e2c852c62634e0e040a => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:17.032683 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ff16f-775a-469f-a988-5d1c4bd77ea1 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:17.037392 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:17.046023 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:17.054662 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d1c39-d883-4909-87cf-5de68a0282e9 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:17.094074 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bc3ba-5e9b-4709-92dc-7c1c78be06d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:17.094758 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bc3ba-5e9b-4709-92dc-7c1c78be06d1 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.095034 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bc3ba-5e9b-4709-92dc-7c1c78be06d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.095304 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bc3ba-5e9b-4709-92dc-7c1c78be06d1 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.096440 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bc3ba-5e9b-4709-92dc-7c1c78be06d1 None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:17.097887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bc3ba-5e9b-4709-92dc-7c1c78be06d1 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:17.099570 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 90/176] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:16 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:17.103840 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c402d4-0618-4bd5-8116-74cc4ec4852b None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.103840 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c402d4-0618-4bd5-8116-74cc4ec4852b None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.103840 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c402d4-0618-4bd5-8116-74cc4ec4852b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.119448 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-c1c402d4-0618-4bd5-8116-74cc4ec4852b None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:17.120630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-c1c402d4-0618-4bd5-8116-74cc4ec4852b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:17.147943 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ff16f-775a-469f-a988-5d1c4bd77ea1 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:17.185332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8ec8b-2647-4daa-854e-8c458a179a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:17.185965 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8ec8b-2647-4daa-854e-8c458a179a1a None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.186237 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8ec8b-2647-4daa-854e-8c458a179a1a None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.186555 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8ec8b-2647-4daa-854e-8c458a179a1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.187357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8ec8b-2647-4daa-854e-8c458a179a1a None admin] RBAC: Adding query filter params (role.id=c483c855d04b4145a203e1f0eedf3c0c, scope.project.id=c62a83be94084167974e9ec84f6f7149, user.id=2ea2941f7ce84e2c852c62634e0e040a) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:17.187663 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8ec8b-2647-4daa-854e-8c458a179a1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:17.189122 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8ec8b-2647-4daa-854e-8c458a179a1a None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:17.191336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 91/177] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:17.191772 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46963059-de93-4fa0-909d-2b835af758d5 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.192079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46963059-de93-4fa0-909d-2b835af758d5 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.192413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46963059-de93-4fa0-909d-2b835af758d5 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.193586 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 92/178] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:17.195112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a861f7-8f5c-4398-a686-c37f6a05708a None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.195112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a861f7-8f5c-4398-a686-c37f6a05708a None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.195281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a861f7-8f5c-4398-a686-c37f6a05708a None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.196445 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 93/179] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:17.197159 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a861f7-8f5c-4398-a686-c37f6a05708a None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:17.208254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 87/180] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:17 2022] GET /identity/v3/role_assignments?user.id=2ea2941f7ce84e2c852c62634e0e040a&scope.project.id=c62a83be94084167974e9ec84f6f7149&role.id=c483c855d04b4145a203e1f0eedf3c0c => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:17.209467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f1514-ffaa-4b9a-b97e-1fa84b5360ff None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.209765 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f1514-ffaa-4b9a-b97e-1fa84b5360ff None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.210001 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f1514-ffaa-4b9a-b97e-1fa84b5360ff None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.211494 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 88/181] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:17.212168 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f1514-ffaa-4b9a-b97e-1fa84b5360ff None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:17.308083 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:17.322562 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:17.342297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a861f7-8f5c-4398-a686-c37f6a05708a None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:17.346901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f1514-ffaa-4b9a-b97e-1fa84b5360ff None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:17.390453 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6264861-06ad-4e46-89eb-f792b2ceb617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:17.391124 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6264861-06ad-4e46-89eb-f792b2ceb617 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.391404 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6264861-06ad-4e46-89eb-f792b2ceb617 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.391677 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6264861-06ad-4e46-89eb-f792b2ceb617 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.394648 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa52e05-90f4-4eba-8230-2756529e9782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:17.395290 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa52e05-90f4-4eba-8230-2756529e9782 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.395559 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa52e05-90f4-4eba-8230-2756529e9782 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.395827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa52e05-90f4-4eba-8230-2756529e9782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.396640 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa52e05-90f4-4eba-8230-2756529e9782 None admin] RBAC: Adding query filter params (role.id=7d88b748366a42929784db05d53fe473, scope.project.id=da2d23ccca37438b90e87196aa0fbe36, user.id=a7aff02dbe9d4c34ad6d286018218135) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:17.396949 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa52e05-90f4-4eba-8230-2756529e9782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:17.398468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa52e05-90f4-4eba-8230-2756529e9782 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:17.407025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 89/182] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:17 2022] GET /identity/v3/role_assignments?user.id=a7aff02dbe9d4c34ad6d286018218135&scope.project.id=da2d23ccca37438b90e87196aa0fbe36&role.id=7d88b748366a42929784db05d53fe473 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:17.408464 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee815b-166b-4cbe-997b-0f6dfc08358c None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.408747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee815b-166b-4cbe-997b-0f6dfc08358c None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.409013 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee815b-166b-4cbe-997b-0f6dfc08358c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.438998 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-0fee815b-166b-4cbe-997b-0f6dfc08358c None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:17.441728 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-0fee815b-166b-4cbe-997b-0f6dfc08358c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:17.506395 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6264861-06ad-4e46-89eb-f792b2ceb617 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:17.508571 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6264861-06ad-4e46-89eb-f792b2ceb617 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:17.557206 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 90/183] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:17.558474 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aef3da-f471-497d-b53b-4b28b8fb0741 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.558686 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aef3da-f471-497d-b53b-4b28b8fb0741 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.558951 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aef3da-f471-497d-b53b-4b28b8fb0741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.588916 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-b9aef3da-f471-497d-b53b-4b28b8fb0741 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:17.591454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-b9aef3da-f471-497d-b53b-4b28b8fb0741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:17.628246 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:17.650877 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 94/184] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:17.652248 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78b484-0871-4d85-9c43-06a35686fe31 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.652531 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78b484-0871-4d85-9c43-06a35686fe31 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.652803 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78b484-0871-4d85-9c43-06a35686fe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.674672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-db78b484-0871-4d85-9c43-06a35686fe31 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:17.675878 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-db78b484-0871-4d85-9c43-06a35686fe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:17.681822 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:17.692677 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 91/185] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:17.693770 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aef3da-f471-497d-b53b-4b28b8fb0741 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:17.766460 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 95/186] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:17.766460 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78b484-0871-4d85-9c43-06a35686fe31 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:17.820186 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aef3da-f471-497d-b53b-4b28b8fb0741 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:17.865094 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3cba3-809f-4efe-9b49-f1d88e162e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:17.865770 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3cba3-809f-4efe-9b49-f1d88e162e69 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.866047 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3cba3-809f-4efe-9b49-f1d88e162e69 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.866305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3cba3-809f-4efe-9b49-f1d88e162e69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.872676 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78b484-0871-4d85-9c43-06a35686fe31 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:17.878223 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3cba3-809f-4efe-9b49-f1d88e162e69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-d0d3cba3-809f-4efe-9b49-f1d88e162e69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:17.883316 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:17.884226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:17.885035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:17.885035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:17.885035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:17.885035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:17.885035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:17.885035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:17.885035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:17.885035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:17.885035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:17.885035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:17.885035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:17.885035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:17.885035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 92/187] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:17.885707 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3cba3-809f-4efe-9b49-f1d88e162e69 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:17.894075 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:17.915090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9b8fe-a582-46e8-b11f-5666cf10609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:17.916131 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9b8fe-a582-46e8-b11f-5666cf10609f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.916405 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9b8fe-a582-46e8-b11f-5666cf10609f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.916675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9b8fe-a582-46e8-b11f-5666cf10609f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.927339 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9b8fe-a582-46e8-b11f-5666cf10609f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-44b9b8fe-a582-46e8-b11f-5666cf10609f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:17.932258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:17.933271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:17.934338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:17.934338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:17.934338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:17.934338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:17.934338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:17.934338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:17.934338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:17.934338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:17.934338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:17.934338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:17.934338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:17.934338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:17.934338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 96/188] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:17.936458 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9b8fe-a582-46e8-b11f-5666cf10609f None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:17.951525 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:17.998564 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3cba3-809f-4efe-9b49-f1d88e162e69 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:18.041364 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e605e8-e46a-45d5-b308-733b05e6b3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:18.042016 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e605e8-e46a-45d5-b308-733b05e6b3c1 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:18.042285 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e605e8-e46a-45d5-b308-733b05e6b3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:18.042587 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e605e8-e46a-45d5-b308-733b05e6b3c1 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:18.043799 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e605e8-e46a-45d5-b308-733b05e6b3c1 None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:18.044714 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9b8fe-a582-46e8-b11f-5666cf10609f None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:18.045243 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e605e8-e46a-45d5-b308-733b05e6b3c1 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:18.047030 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 93/189] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:17 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:18.047810 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e605e8-e46a-45d5-b308-733b05e6b3c1 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:18.086650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ef98c-71f9-4146-ad6c-74134862fbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:18.087211 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ef98c-71f9-4146-ad6c-74134862fbdf None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:18.087479 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ef98c-71f9-4146-ad6c-74134862fbdf None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:18.087747 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ef98c-71f9-4146-ad6c-74134862fbdf None admin] PATH_INFO: `/v3/domains/default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:18.088929 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ef98c-71f9-4146-ad6c-74134862fbdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:18.090457 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ef98c-71f9-4146-ad6c-74134862fbdf None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:18.092066 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 97/190] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:18.092898 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ef98c-71f9-4146-ad6c-74134862fbdf None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:18.148411 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:18.169346 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e605e8-e46a-45d5-b308-733b05e6b3c1 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:18.196090 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:18.211096 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069ccff-65bc-40cf-a166-fc6b29f0e00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:18.212089 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069ccff-65bc-40cf-a166-fc6b29f0e00c None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:18.212526 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069ccff-65bc-40cf-a166-fc6b29f0e00c None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:18.212908 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069ccff-65bc-40cf-a166-fc6b29f0e00c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:18.218568 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ef98c-71f9-4146-ad6c-74134862fbdf None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:18.225975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069ccff-65bc-40cf-a166-fc6b29f0e00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-9069ccff-65bc-40cf-a166-fc6b29f0e00c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:18.231416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:18.232342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:18.233151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:18.233151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:18.233151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:18.233151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:18.233151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:18.233151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:18.233151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:18.233151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:18.233151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:18.233151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:18.233151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:18.233151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:18.233151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 94/191] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:18.233893 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069ccff-65bc-40cf-a166-fc6b29f0e00c None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:18.261674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1207d96-a3a1-407c-8a7f-61c8c38b630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:18.262306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1207d96-a3a1-407c-8a7f-61c8c38b630f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:18.262632 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1207d96-a3a1-407c-8a7f-61c8c38b630f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:18.262907 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1207d96-a3a1-407c-8a7f-61c8c38b630f None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:18.263634 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1207d96-a3a1-407c-8a7f-61c8c38b630f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:18.264643 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1207d96-a3a1-407c-8a7f-61c8c38b630f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:18.265421 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1207d96-a3a1-407c-8a7f-61c8c38b630f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:18.274605 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 98/192] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:18.275440 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1207d96-a3a1-407c-8a7f-61c8c38b630f None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:18.344312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069ccff-65bc-40cf-a166-fc6b29f0e00c None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:18.378113 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf0b43-33c6-4f1b-9aad-1c9806ed4adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:18.378787 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf0b43-33c6-4f1b-9aad-1c9806ed4adb None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:18.379041 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf0b43-33c6-4f1b-9aad-1c9806ed4adb None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:18.379320 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf0b43-33c6-4f1b-9aad-1c9806ed4adb None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:18.380048 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf0b43-33c6-4f1b-9aad-1c9806ed4adb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:18.380357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf0b43-33c6-4f1b-9aad-1c9806ed4adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:18.381762 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf0b43-33c6-4f1b-9aad-1c9806ed4adb None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:18.383521 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1207d96-a3a1-407c-8a7f-61c8c38b630f None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:18.390037 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 95/193] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:18.390841 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:18.390952 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf0b43-33c6-4f1b-9aad-1c9806ed4adb None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:18.430958 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141f1c6-7108-45b1-95e2-024ea40bfdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:18.431591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141f1c6-7108-45b1-95e2-024ea40bfdea None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:18.431864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141f1c6-7108-45b1-95e2-024ea40bfdea None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:18.432128 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141f1c6-7108-45b1-95e2-024ea40bfdea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:18.433119 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141f1c6-7108-45b1-95e2-024ea40bfdea None admin] RBAC: Adding query filter params (role.id=2ae24c72c8264d0ba34cbe573083cc33, scope.project.id=da2d23ccca37438b90e87196aa0fbe36, user.id=2ea2941f7ce84e2c852c62634e0e040a) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:18.433787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141f1c6-7108-45b1-95e2-024ea40bfdea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:18.435471 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141f1c6-7108-45b1-95e2-024ea40bfdea None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:18.454467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 99/194] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:18 2022] GET /identity/v3/role_assignments?user.id=2ea2941f7ce84e2c852c62634e0e040a&scope.project.id=da2d23ccca37438b90e87196aa0fbe36&role.id=2ae24c72c8264d0ba34cbe573083cc33 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:18.454467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141f1c6-7108-45b1-95e2-024ea40bfdea None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:18.459032 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:18.544034 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf0b43-33c6-4f1b-9aad-1c9806ed4adb None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:18.575770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141f1c6-7108-45b1-95e2-024ea40bfdea None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:18.583933 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395d673-b0fe-4961-a186-c9b14aac2da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:18.584831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395d673-b0fe-4961-a186-c9b14aac2da2 None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:18.585267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395d673-b0fe-4961-a186-c9b14aac2da2 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:18.585521 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395d673-b0fe-4961-a186-c9b14aac2da2 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:18.586385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395d673-b0fe-4961-a186-c9b14aac2da2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:18.588108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395d673-b0fe-4961-a186-c9b14aac2da2 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:18.622546 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 96/195] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Jul 26 10:13:18 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:18.622729 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc9cc5-2026-44d6-8e90-0148dbb7d62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:18.622729 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc9cc5-2026-44d6-8e90-0148dbb7d62f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:18.622729 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc9cc5-2026-44d6-8e90-0148dbb7d62f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:18.622729 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc9cc5-2026-44d6-8e90-0148dbb7d62f None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:18.623005 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc9cc5-2026-44d6-8e90-0148dbb7d62f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:18.623005 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc9cc5-2026-44d6-8e90-0148dbb7d62f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:18.625567 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395d673-b0fe-4961-a186-c9b14aac2da2 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:18.625742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc9cc5-2026-44d6-8e90-0148dbb7d62f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:18.639365 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 100/196] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:18.640501 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc9cc5-2026-44d6-8e90-0148dbb7d62f None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:18.750168 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395d673-b0fe-4961-a186-c9b14aac2da2 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:18.752153 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:18.795763 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd1c87-92d1-4100-9d34-27944224f91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:18.796443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd1c87-92d1-4100-9d34-27944224f91b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:18.796724 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd1c87-92d1-4100-9d34-27944224f91b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:18.796990 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd1c87-92d1-4100-9d34-27944224f91b None admin] PATH_INFO: `/v3/users/91a88c523202478e9271ed8da984af53` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:18.810047 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:18.814102 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd1c87-92d1-4100-9d34-27944224f91b None admin] RBAC: Authorizing `identity:get_user(user_id=91a88c523202478e9271ed8da984af53)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:18.815742 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd1c87-92d1-4100-9d34-27944224f91b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:18.817505 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 97/197] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:18 2022] GET /identity/v3/users/91a88c523202478e9271ed8da984af53 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:18.820752 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd1c87-92d1-4100-9d34-27944224f91b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:18.907842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc9cc5-2026-44d6-8e90-0148dbb7d62f None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:18.944948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd1c87-92d1-4100-9d34-27944224f91b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:18.958000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f87989-ae78-4cba-be20-d34092ee5ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:18.958813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f87989-ae78-4cba-be20-d34092ee5ee6 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:18.959154 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f87989-ae78-4cba-be20-d34092ee5ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:18.959491 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f87989-ae78-4cba-be20-d34092ee5ee6 None admin] PATH_INFO: `/v3/users/91a88c523202478e9271ed8da984af53` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:18.960738 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f87989-ae78-4cba-be20-d34092ee5ee6 None admin] RBAC: Authorizing `identity:get_user(user_id=91a88c523202478e9271ed8da984af53)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:18.962267 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f87989-ae78-4cba-be20-d34092ee5ee6 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:18.964190 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 101/198] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:18 2022] GET /identity/v3/users/91a88c523202478e9271ed8da984af53 => generated 283 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:18.964947 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f87989-ae78-4cba-be20-d34092ee5ee6 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:18.989951 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4ccf8-46af-444c-8cde-754c76c0029b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:18.990638 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4ccf8-46af-444c-8cde-754c76c0029b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:18.990919 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4ccf8-46af-444c-8cde-754c76c0029b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:18.991186 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4ccf8-46af-444c-8cde-754c76c0029b None admin] PATH_INFO: `/v3/users/0e79567de29645659686e7a653cc6112` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:18.992967 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4ccf8-46af-444c-8cde-754c76c0029b None admin] RBAC: Authorizing `identity:get_user(user_id=0e79567de29645659686e7a653cc6112)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:18.994424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4ccf8-46af-444c-8cde-754c76c0029b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:18.996229 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 98/199] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:18 2022] GET /identity/v3/users/0e79567de29645659686e7a653cc6112 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:18.996881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4ccf8-46af-444c-8cde-754c76c0029b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:19.034721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:19.114974 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:19.115172 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4ccf8-46af-444c-8cde-754c76c0029b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:19.120267 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f87989-ae78-4cba-be20-d34092ee5ee6 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:19.153394 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e85a04-6e6e-4b10-838c-d828de84ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:19.154029 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e85a04-6e6e-4b10-838c-d828de84ea43 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:19.154301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e85a04-6e6e-4b10-838c-d828de84ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:19.154625 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e85a04-6e6e-4b10-838c-d828de84ea43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:19.175825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a292f1a-900f-4233-8742-70cbf2ae52bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:19.177061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a292f1a-900f-4233-8742-70cbf2ae52bf None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:19.177828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a292f1a-900f-4233-8742-70cbf2ae52bf None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:19.178304 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a292f1a-900f-4233-8742-70cbf2ae52bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:19.241045 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e85a04-6e6e-4b10-838c-d828de84ea43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:19.243273 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e85a04-6e6e-4b10-838c-d828de84ea43 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:19.254886 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a292f1a-900f-4233-8742-70cbf2ae52bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:19.256374 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a292f1a-900f-4233-8742-70cbf2ae52bf None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:19.292692 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:19.379619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:19.384308 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 102/200] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:19.386109 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a292f1a-900f-4233-8742-70cbf2ae52bf None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:19.403284 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 99/201] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:19.405101 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e85a04-6e6e-4b10-838c-d828de84ea43 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:19.504173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a292f1a-900f-4233-8742-70cbf2ae52bf None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:19.535168 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e85a04-6e6e-4b10-838c-d828de84ea43 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:19.541737 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60079048-f044-452a-aa49-0ce3e454c8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:19.542529 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60079048-f044-452a-aa49-0ce3e454c8b5 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:19.542877 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60079048-f044-452a-aa49-0ce3e454c8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:19.543218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60079048-f044-452a-aa49-0ce3e454c8b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:19.571499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:19.582135 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc5189-f0da-46ae-98eb-b60ecf20c226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:19.584282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc5189-f0da-46ae-98eb-b60ecf20c226 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:19.584781 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc5189-f0da-46ae-98eb-b60ecf20c226 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:19.585354 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc5189-f0da-46ae-98eb-b60ecf20c226 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:19.587270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc5189-f0da-46ae-98eb-b60ecf20c226 None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:19.591940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc5189-f0da-46ae-98eb-b60ecf20c226 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:19.595187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 100/202] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:19 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:19.596233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc5189-f0da-46ae-98eb-b60ecf20c226 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:19.620122 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:19.623628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60079048-f044-452a-aa49-0ce3e454c8b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:19.626236 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60079048-f044-452a-aa49-0ce3e454c8b5 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:19.703457 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc5189-f0da-46ae-98eb-b60ecf20c226 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:19.735283 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 103/203] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:19.739974 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60079048-f044-452a-aa49-0ce3e454c8b5 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:19.743505 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf4f99-d284-43fb-88a4-5277373bd029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:19.744402 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf4f99-d284-43fb-88a4-5277373bd029 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:19.744846 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf4f99-d284-43fb-88a4-5277373bd029 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:19.745273 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf4f99-d284-43fb-88a4-5277373bd029 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:19.746667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf4f99-d284-43fb-88a4-5277373bd029 None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:19.748294 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf4f99-d284-43fb-88a4-5277373bd029 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:19.750551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 101/204] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:19 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:19.751778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf4f99-d284-43fb-88a4-5277373bd029 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:19.815311 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:19.842295 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:19.846495 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60079048-f044-452a-aa49-0ce3e454c8b5 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:19.854868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf4f99-d284-43fb-88a4-5277373bd029 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:19.885494 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca2700-d62d-40f4-8959-cbf4897cfc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:19.886489 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca2700-d62d-40f4-8959-cbf4897cfc3f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:19.886925 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca2700-d62d-40f4-8959-cbf4897cfc3f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:19.887425 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca2700-d62d-40f4-8959-cbf4897cfc3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:19.888375 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca2700-d62d-40f4-8959-cbf4897cfc3f None admin] RBAC: Adding query filter params (role.id=7d88b748366a42929784db05d53fe473, scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1, user.id=91a88c523202478e9271ed8da984af53) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:19.888685 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca2700-d62d-40f4-8959-cbf4897cfc3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:19.890178 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca2700-d62d-40f4-8959-cbf4897cfc3f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:19.891811 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95382dec-9aa1-4e12-b435-9f5c36fd90e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:19.892567 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95382dec-9aa1-4e12-b435-9f5c36fd90e2 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:19.892938 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95382dec-9aa1-4e12-b435-9f5c36fd90e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:19.893306 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95382dec-9aa1-4e12-b435-9f5c36fd90e2 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:19.894627 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95382dec-9aa1-4e12-b435-9f5c36fd90e2 None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:19.896188 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95382dec-9aa1-4e12-b435-9f5c36fd90e2 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:19.896433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 104/205] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:19 2022] GET /identity/v3/role_assignments?user.id=91a88c523202478e9271ed8da984af53&scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1&role.id=7d88b748366a42929784db05d53fe473 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:19.897261 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca2700-d62d-40f4-8959-cbf4897cfc3f None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:19.898386 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 102/206] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:19 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:19.904878 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95382dec-9aa1-4e12-b435-9f5c36fd90e2 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:20.013773 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca2700-d62d-40f4-8959-cbf4897cfc3f None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:20.033265 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95382dec-9aa1-4e12-b435-9f5c36fd90e2 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:20.054738 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae0027-bdb0-47ae-a927-0c2962a2c30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:20.055385 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae0027-bdb0-47ae-a927-0c2962a2c30f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:20.055663 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae0027-bdb0-47ae-a927-0c2962a2c30f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:20.055933 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae0027-bdb0-47ae-a927-0c2962a2c30f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:20.056761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae0027-bdb0-47ae-a927-0c2962a2c30f None admin] RBAC: Adding query filter params (role.id=2ae24c72c8264d0ba34cbe573083cc33, scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1, user.id=91a88c523202478e9271ed8da984af53) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:20.057150 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae0027-bdb0-47ae-a927-0c2962a2c30f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:20.058724 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae0027-bdb0-47ae-a927-0c2962a2c30f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:20.065904 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 105/207] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:19 2022] GET /identity/v3/role_assignments?user.id=91a88c523202478e9271ed8da984af53&scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1&role.id=2ae24c72c8264d0ba34cbe573083cc33 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:20.103879 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:20.110757 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fadbfa-60e5-4963-bbb9-6898e4c083fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:20.111405 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fadbfa-60e5-4963-bbb9-6898e4c083fe None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:20.111683 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fadbfa-60e5-4963-bbb9-6898e4c083fe None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:20.111952 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fadbfa-60e5-4963-bbb9-6898e4c083fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:20.112863 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fadbfa-60e5-4963-bbb9-6898e4c083fe None admin] RBAC: Adding query filter params (role.id=3d8f099531114c74ad03cc59fe401ee9, scope.project.id=da2d23ccca37438b90e87196aa0fbe36, user.id=0e79567de29645659686e7a653cc6112) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:20.113177 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fadbfa-60e5-4963-bbb9-6898e4c083fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:20.114709 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fadbfa-60e5-4963-bbb9-6898e4c083fe None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:20.127828 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 103/208] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:19 2022] GET /identity/v3/role_assignments?user.id=0e79567de29645659686e7a653cc6112&scope.project.id=da2d23ccca37438b90e87196aa0fbe36&role.id=3d8f099531114c74ad03cc59fe401ee9 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:21.111250 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2c041-e412-42d2-9fca-ff56ade3f509 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.112247 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2c041-e412-42d2-9fca-ff56ade3f509 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.112764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2c041-e412-42d2-9fca-ff56ade3f509 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.114717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 106/209] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:21.120677 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676540c-613f-4b83-80b5-5737eff3223e None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.121557 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676540c-613f-4b83-80b5-5737eff3223e None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.122023 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676540c-613f-4b83-80b5-5737eff3223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.142188 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-c676540c-613f-4b83-80b5-5737eff3223e None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:21.143808 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-c676540c-613f-4b83-80b5-5737eff3223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:21.220398 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 104/210] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:21.246191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2c041-e412-42d2-9fca-ff56ade3f509 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:21.280906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:21.337923 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f600964-c287-48a3-bf3e-1d268e6f6b01 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.338265 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f600964-c287-48a3-bf3e-1d268e6f6b01 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.338572 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f600964-c287-48a3-bf3e-1d268e6f6b01 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.341715 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 105/211] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:21.346394 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae121-dcd7-4cfb-9c7a-41c256508286 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.346705 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae121-dcd7-4cfb-9c7a-41c256508286 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.346963 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae121-dcd7-4cfb-9c7a-41c256508286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.365570 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-bcaae121-dcd7-4cfb-9c7a-41c256508286 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:21.366802 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-bcaae121-dcd7-4cfb-9c7a-41c256508286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:21.368107 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2c041-e412-42d2-9fca-ff56ade3f509 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:21.405488 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cbe7d-7822-46eb-86c6-c56c1990bb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:21.406553 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cbe7d-7822-46eb-86c6-c56c1990bb79 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.407025 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cbe7d-7822-46eb-86c6-c56c1990bb79 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.407485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cbe7d-7822-46eb-86c6-c56c1990bb79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.419810 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cbe7d-7822-46eb-86c6-c56c1990bb79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-df2cbe7d-7822-46eb-86c6-c56c1990bb79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:21.425807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:21.426861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:21.427692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:21.427692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:21.427692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:21.427692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:21.427692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:21.427692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:21.427692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:21.427692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:21.427692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:21.427692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:21.427692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:21.427692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:21.430672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 107/212] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:21.436265 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cbe7d-7822-46eb-86c6-c56c1990bb79 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:21.446577 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 106/213] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:21.472893 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae121-dcd7-4cfb-9c7a-41c256508286 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:21.538576 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:21.552602 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:21.569861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cbe7d-7822-46eb-86c6-c56c1990bb79 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:21.586587 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae121-dcd7-4cfb-9c7a-41c256508286 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:21.607665 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a043d6-ac56-4c9a-969a-73a95ff2935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:21.608609 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a043d6-ac56-4c9a-969a-73a95ff2935f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.609024 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a043d6-ac56-4c9a-969a-73a95ff2935f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.609429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a043d6-ac56-4c9a-969a-73a95ff2935f None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.610516 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a043d6-ac56-4c9a-969a-73a95ff2935f None admin] RBAC: Adding query filter params (name=member) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:21.611059 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a043d6-ac56-4c9a-969a-73a95ff2935f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:21.612621 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a043d6-ac56-4c9a-969a-73a95ff2935f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:21.622246 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 108/214] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:21.630098 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a043d6-ac56-4c9a-969a-73a95ff2935f None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:21.633570 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754acbe-7ae2-4c9c-8416-385c8cb41092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:21.634664 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754acbe-7ae2-4c9c-8416-385c8cb41092 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.635325 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754acbe-7ae2-4c9c-8416-385c8cb41092 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.635897 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754acbe-7ae2-4c9c-8416-385c8cb41092 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.637389 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754acbe-7ae2-4c9c-8416-385c8cb41092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:21.639112 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754acbe-7ae2-4c9c-8416-385c8cb41092 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:21.646209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 107/215] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:21.647961 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754acbe-7ae2-4c9c-8416-385c8cb41092 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:21.756949 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754acbe-7ae2-4c9c-8416-385c8cb41092 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:21.770587 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a043d6-ac56-4c9a-969a-73a95ff2935f None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:21.790897 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:21.798615 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc791d4f-db90-4add-a1b0-6ea0d78a1a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:21.799684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc791d4f-db90-4add-a1b0-6ea0d78a1a44 None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.800262 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc791d4f-db90-4add-a1b0-6ea0d78a1a44 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.800721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc791d4f-db90-4add-a1b0-6ea0d78a1a44 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.801626 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc791d4f-db90-4add-a1b0-6ea0d78a1a44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:21.803507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc791d4f-db90-4add-a1b0-6ea0d78a1a44 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:21.811371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674dc83-3235-4675-af77-89d8c2d2cc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:21.812033 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674dc83-3235-4675-af77-89d8c2d2cc3c None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.812315 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674dc83-3235-4675-af77-89d8c2d2cc3c None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.812589 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674dc83-3235-4675-af77-89d8c2d2cc3c None admin] PATH_INFO: `/v3/users/0e12529d281140208a6b8935ceb7626e` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.830159 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674dc83-3235-4675-af77-89d8c2d2cc3c None admin] RBAC: Authorizing `identity:get_user(user_id=0e12529d281140208a6b8935ceb7626e)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:21.831743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674dc83-3235-4675-af77-89d8c2d2cc3c None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:21.833691 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 109/216] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:21 2022] GET /identity/v3/users/0e12529d281140208a6b8935ceb7626e => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:21.838233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 108/217] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Jul 26 10:13:21 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:13:21.841536 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674dc83-3235-4675-af77-89d8c2d2cc3c None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:21.854960 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:21.971048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674dc83-3235-4675-af77-89d8c2d2cc3c None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:22.021601 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685bf6e-02ad-400a-985a-507f6afecb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:22.022272 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685bf6e-02ad-400a-985a-507f6afecb39 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.022643 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685bf6e-02ad-400a-985a-507f6afecb39 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.022918 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685bf6e-02ad-400a-985a-507f6afecb39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.099039 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685bf6e-02ad-400a-985a-507f6afecb39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:22.100449 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685bf6e-02ad-400a-985a-507f6afecb39 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:22.111602 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:22.207837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 110/218] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:13:22.213669 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc791d4f-db90-4add-a1b0-6ea0d78a1a44 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:22.330186 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc791d4f-db90-4add-a1b0-6ea0d78a1a44 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:22.376893 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273a51f-3e50-4e0e-9557-f872a83278d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:22.377526 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273a51f-3e50-4e0e-9557-f872a83278d7 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.377781 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273a51f-3e50-4e0e-9557-f872a83278d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.378055 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273a51f-3e50-4e0e-9557-f872a83278d7 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.379343 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273a51f-3e50-4e0e-9557-f872a83278d7 None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:22.380815 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273a51f-3e50-4e0e-9557-f872a83278d7 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:22.385237 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 109/219] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:22 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:22.389199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685bf6e-02ad-400a-985a-507f6afecb39 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:22.509544 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37eb6c-bb66-43c1-ac8f-d855c0e4e9dd None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.509830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37eb6c-bb66-43c1-ac8f-d855c0e4e9dd None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.510109 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37eb6c-bb66-43c1-ac8f-d855c0e4e9dd None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.511795 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 110/220] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:22.517097 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413166f3-0853-4445-b78d-82749f1ebeb9 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.517379 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413166f3-0853-4445-b78d-82749f1ebeb9 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.517658 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413166f3-0853-4445-b78d-82749f1ebeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.528831 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685bf6e-02ad-400a-985a-507f6afecb39 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:22.547659 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:22.554830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-413166f3-0853-4445-b78d-82749f1ebeb9 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:22.556049 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-413166f3-0853-4445-b78d-82749f1ebeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:22.600715 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b0e1f-55cf-446e-92af-682fb2daf899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:22.601349 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b0e1f-55cf-446e-92af-682fb2daf899 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.601626 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b0e1f-55cf-446e-92af-682fb2daf899 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.601900 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b0e1f-55cf-446e-92af-682fb2daf899 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.602825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b0e1f-55cf-446e-92af-682fb2daf899 None admin] RBAC: Adding query filter params (role.id=c483c855d04b4145a203e1f0eedf3c0c, scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1, user.id=0e12529d281140208a6b8935ceb7626e) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:22.603138 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b0e1f-55cf-446e-92af-682fb2daf899 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:22.605914 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b0e1f-55cf-446e-92af-682fb2daf899 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:22.617387 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 111/221] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:22 2022] GET /identity/v3/role_assignments?user.id=0e12529d281140208a6b8935ceb7626e&scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1&role.id=c483c855d04b4145a203e1f0eedf3c0c => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:22.643146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:22.679298 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 111/222] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:22.691517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cdba4-e983-40e5-a960-01fc51fea117 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.691836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cdba4-e983-40e5-a960-01fc51fea117 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.692062 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cdba4-e983-40e5-a960-01fc51fea117 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.693828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 112/223] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:22.699859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e385a-248b-4259-a54e-ecef3db55b30 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.700131 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e385a-248b-4259-a54e-ecef3db55b30 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.700403 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e385a-248b-4259-a54e-ecef3db55b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.716075 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cdba4-e983-40e5-a960-01fc51fea117 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:22.730776 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-185e385a-248b-4259-a54e-ecef3db55b30 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:22.732262 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-185e385a-248b-4259-a54e-ecef3db55b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:22.851609 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 112/224] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:22.875241 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e385a-248b-4259-a54e-ecef3db55b30 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:22.928404 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cdba4-e983-40e5-a960-01fc51fea117 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:22.998241 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8069b-8303-472c-b205-8b0d9f652577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:22.999501 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8069b-8303-472c-b205-8b0d9f652577 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.999976 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8069b-8303-472c-b205-8b0d9f652577 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:23.000438 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8069b-8303-472c-b205-8b0d9f652577 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:23.048921 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8069b-8303-472c-b205-8b0d9f652577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:23.051636 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e385a-248b-4259-a54e-ecef3db55b30 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-ebf8069b-8303-472c-b205-8b0d9f652577 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:23.057068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:23.058213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:23.059178 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:23.059178 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:23.059178 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:23.059178 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:23.059178 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:23.059178 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:23.059178 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:23.059178 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:23.059178 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:23.059178 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:23.059178 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:23.059178 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:23.071048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 113/225] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:23.076517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8069b-8303-472c-b205-8b0d9f652577 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:23.086834 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:23.134274 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81d537-5c3c-4de9-b2b8-5d849db5f479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:23.135407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81d537-5c3c-4de9-b2b8-5d849db5f479 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:23.136495 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81d537-5c3c-4de9-b2b8-5d849db5f479 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:23.137064 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81d537-5c3c-4de9-b2b8-5d849db5f479 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:23.140321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:23.165377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81d537-5c3c-4de9-b2b8-5d849db5f479 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-af81d537-5c3c-4de9-b2b8-5d849db5f479 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:23.171192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:23.172317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:23.173312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:23.173312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:23.173312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:23.173312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:23.173312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:23.173312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:23.173312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:23.173312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:23.173312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:23.173312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:23.173312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:23.173312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:23.177584 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 113/226] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:23.182641 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81d537-5c3c-4de9-b2b8-5d849db5f479 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:23.243227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8069b-8303-472c-b205-8b0d9f652577 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:23.285665 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87f0ae-2afc-4f97-85da-490c6ba5f5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:23.286315 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87f0ae-2afc-4f97-85da-490c6ba5f5ca None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:23.286668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87f0ae-2afc-4f97-85da-490c6ba5f5ca None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:23.286912 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87f0ae-2afc-4f97-85da-490c6ba5f5ca None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:23.287654 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87f0ae-2afc-4f97-85da-490c6ba5f5ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:23.287954 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87f0ae-2afc-4f97-85da-490c6ba5f5ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:23.289397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87f0ae-2afc-4f97-85da-490c6ba5f5ca None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:23.299716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 114/227] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:23.305906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87f0ae-2afc-4f97-85da-490c6ba5f5ca None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:23.463468 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:23.471131 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87f0ae-2afc-4f97-85da-490c6ba5f5ca None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:23.506904 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81d537-5c3c-4de9-b2b8-5d849db5f479 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:23.510844 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4edd5-eee4-43dc-aeba-c249a7290a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:23.512038 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4edd5-eee4-43dc-aeba-c249a7290a45 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:23.512387 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4edd5-eee4-43dc-aeba-c249a7290a45 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:23.512762 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4edd5-eee4-43dc-aeba-c249a7290a45 None admin] PATH_INFO: `/v3/users/91a88c523202478e9271ed8da984af53` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:23.517853 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4edd5-eee4-43dc-aeba-c249a7290a45 None admin] RBAC: Authorizing `identity:get_user(user_id=91a88c523202478e9271ed8da984af53)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:23.517853 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4edd5-eee4-43dc-aeba-c249a7290a45 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:23.524629 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 115/228] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:23 2022] GET /identity/v3/users/91a88c523202478e9271ed8da984af53 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:23.526953 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4edd5-eee4-43dc-aeba-c249a7290a45 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:23.615376 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28e369-eab7-4993-a429-2edaff5b1057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:23.616026 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28e369-eab7-4993-a429-2edaff5b1057 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:23.616304 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28e369-eab7-4993-a429-2edaff5b1057 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:23.616572 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28e369-eab7-4993-a429-2edaff5b1057 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:23.617324 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28e369-eab7-4993-a429-2edaff5b1057 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:23.617629 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28e369-eab7-4993-a429-2edaff5b1057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:23.619104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28e369-eab7-4993-a429-2edaff5b1057 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:23.640827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 114/229] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:23.647435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28e369-eab7-4993-a429-2edaff5b1057 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:23.710869 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:23.744590 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4edd5-eee4-43dc-aeba-c249a7290a45 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:23.836605 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd16f5-5664-4a5f-9fbe-787eec1cd7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:23.837899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd16f5-5664-4a5f-9fbe-787eec1cd7de None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:23.838371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd16f5-5664-4a5f-9fbe-787eec1cd7de None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:23.838877 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd16f5-5664-4a5f-9fbe-787eec1cd7de None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:23.841115 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd16f5-5664-4a5f-9fbe-787eec1cd7de None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:23.843980 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd16f5-5664-4a5f-9fbe-787eec1cd7de None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:23.847699 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 116/230] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:23 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:23.853651 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd16f5-5664-4a5f-9fbe-787eec1cd7de None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:23.892190 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28e369-eab7-4993-a429-2edaff5b1057 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:23.916277 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:23.951197 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914738-f2b1-44c7-9543-dbb9a1f69db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:23.952000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914738-f2b1-44c7-9543-dbb9a1f69db3 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:23.952275 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914738-f2b1-44c7-9543-dbb9a1f69db3 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:23.952553 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914738-f2b1-44c7-9543-dbb9a1f69db3 None admin] PATH_INFO: `/v3/users/91a88c523202478e9271ed8da984af53` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:23.953822 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86914738-f2b1-44c7-9543-dbb9a1f69db3 None admin] RBAC: Authorizing `identity:get_user(user_id=91a88c523202478e9271ed8da984af53)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:23.955353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86914738-f2b1-44c7-9543-dbb9a1f69db3 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:23.957113 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 115/231] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:23 2022] GET /identity/v3/users/91a88c523202478e9271ed8da984af53 => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:23.963014 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914738-f2b1-44c7-9543-dbb9a1f69db3 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:24.060702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd16f5-5664-4a5f-9fbe-787eec1cd7de None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:24.130468 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069c058-b745-4990-af5e-f13bf57cf274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:24.131148 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069c058-b745-4990-af5e-f13bf57cf274 None admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:24.131422 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069c058-b745-4990-af5e-f13bf57cf274 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:24.131690 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069c058-b745-4990-af5e-f13bf57cf274 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1/users/91a88c523202478e9271ed8da984af53/roles/7d88b748366a42929784db05d53fe473` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:24.135084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069c058-b745-4990-af5e-f13bf57cf274 None admin] RBAC: Authorizing `identity:create_grant(project_id=63fd00e8a9034be59d866bb49c6a5cf1, user_id=91a88c523202478e9271ed8da984af53, role_id=7d88b748366a42929784db05d53fe473)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:24.136746 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069c058-b745-4990-af5e-f13bf57cf274 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:24.164320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 117/232] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:13:23 2022] PUT /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1/users/91a88c523202478e9271ed8da984af53/roles/7d88b748366a42929784db05d53fe473 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:24.168202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:24.177675 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914738-f2b1-44c7-9543-dbb9a1f69db3 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:24.245382 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd5c6a-c1bf-4200-9214-2a81a42476d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:24.246066 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd5c6a-c1bf-4200-9214-2a81a42476d7 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:24.246344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd5c6a-c1bf-4200-9214-2a81a42476d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:24.246648 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd5c6a-c1bf-4200-9214-2a81a42476d7 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:24.251405 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd5c6a-c1bf-4200-9214-2a81a42476d7 None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:24.252950 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd5c6a-c1bf-4200-9214-2a81a42476d7 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:24.255264 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 116/233] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:23 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:24.261569 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069c058-b745-4990-af5e-f13bf57cf274 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:24.396789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:24.408874 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069c058-b745-4990-af5e-f13bf57cf274 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:24.447664 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cc051-b88b-4aeb-9356-c30aa69f66e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:24.448953 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cc051-b88b-4aeb-9356-c30aa69f66e0 None admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:24.449456 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cc051-b88b-4aeb-9356-c30aa69f66e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:24.450035 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cc051-b88b-4aeb-9356-c30aa69f66e0 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1/users/91a88c523202478e9271ed8da984af53/roles/2ae24c72c8264d0ba34cbe573083cc33` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:24.452766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cc051-b88b-4aeb-9356-c30aa69f66e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=63fd00e8a9034be59d866bb49c6a5cf1, user_id=91a88c523202478e9271ed8da984af53, role_id=2ae24c72c8264d0ba34cbe573083cc33)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:24.454459 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cc051-b88b-4aeb-9356-c30aa69f66e0 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:24.474146 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 118/234] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:13:24 2022] PUT /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1/users/91a88c523202478e9271ed8da984af53/roles/2ae24c72c8264d0ba34cbe573083cc33 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:24.958089 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767d57d-6a3c-4341-9f4b-19c3b55b9585 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:24.958681 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767d57d-6a3c-4341-9f4b-19c3b55b9585 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:24.958681 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767d57d-6a3c-4341-9f4b-19c3b55b9585 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:24.960182 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 117/235] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:24.980132 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ece8b-6aba-4a12-8c81-d38417297627 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:24.980799 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ece8b-6aba-4a12-8c81-d38417297627 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:24.981288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ece8b-6aba-4a12-8c81-d38417297627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:24.989416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80388e-b2ba-403e-9e9c-1a45027d8cf0 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:24.989721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80388e-b2ba-403e-9e9c-1a45027d8cf0 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:24.990009 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80388e-b2ba-403e-9e9c-1a45027d8cf0 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:24.991472 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 118/236] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:24.997015 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0eb67-e349-4838-bb68-577a5c3e158f None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:24.997300 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0eb67-e349-4838-bb68-577a5c3e158f None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:24.997582 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0eb67-e349-4838-bb68-577a5c3e158f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.004236 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-407ece8b-6aba-4a12-8c81-d38417297627 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:25.005750 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-407ece8b-6aba-4a12-8c81-d38417297627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:25.043569 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-4ae0eb67-e349-4838-bb68-577a5c3e158f None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:25.044819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-4ae0eb67-e349-4838-bb68-577a5c3e158f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:25.102525 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 119/237] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:25.122600 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ece8b-6aba-4a12-8c81-d38417297627 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:25.205713 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 119/238] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:25.237369 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0eb67-e349-4838-bb68-577a5c3e158f None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:25.262860 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:25.307440 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ece8b-6aba-4a12-8c81-d38417297627 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:25.353733 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52faa89e-e0cb-45a6-ae43-272a0d7bc72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:25.354405 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faa89e-e0cb-45a6-ae43-272a0d7bc72d None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.354707 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faa89e-e0cb-45a6-ae43-272a0d7bc72d None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.354974 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faa89e-e0cb-45a6-ae43-272a0d7bc72d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.366077 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:25.366269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52faa89e-e0cb-45a6-ae43-272a0d7bc72d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-52faa89e-e0cb-45a6-ae43-272a0d7bc72d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:25.372231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:25.373189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:25.379201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:25.379201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:25.379201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:25.379201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:25.379201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:25.379201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:25.379201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:25.379201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:25.379201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:25.379201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:25.379201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:25.379201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:25.379201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 120/239] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:25.379201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f5a7b-d888-4c31-acd4-4f05c3ac5e6d None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.379921 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f5a7b-d888-4c31-acd4-4f05c3ac5e6d None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.379921 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f5a7b-d888-4c31-acd4-4f05c3ac5e6d None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.379921 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 121/240] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:25.384715 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f5a7b-d888-4c31-acd4-4f05c3ac5e6d None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:25.386368 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0eb67-e349-4838-bb68-577a5c3e158f None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:25.427642 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c486a3-e0cb-4d00-b290-60677a1d8bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:25.428837 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c486a3-e0cb-4d00-b290-60677a1d8bc8 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.429305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c486a3-e0cb-4d00-b290-60677a1d8bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.429786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c486a3-e0cb-4d00-b290-60677a1d8bc8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.431181 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c486a3-e0cb-4d00-b290-60677a1d8bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:25.432985 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c486a3-e0cb-4d00-b290-60677a1d8bc8 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:25.439759 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 120/241] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:25.441599 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2ae30-80ce-4b92-8e76-49995c5dad7f None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.442109 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2ae30-80ce-4b92-8e76-49995c5dad7f None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.442908 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2ae30-80ce-4b92-8e76-49995c5dad7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.463838 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-47d2ae30-80ce-4b92-8e76-49995c5dad7f None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:25.465511 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-47d2ae30-80ce-4b92-8e76-49995c5dad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:25.501265 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f5a7b-d888-4c31-acd4-4f05c3ac5e6d None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:25.543586 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ef4a8-465b-41ec-9c6f-fa17b1d15e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:25.544121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ef4a8-465b-41ec-9c6f-fa17b1d15e86 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.544396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ef4a8-465b-41ec-9c6f-fa17b1d15e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.544660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ef4a8-465b-41ec-9c6f-fa17b1d15e86 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.545570 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ef4a8-465b-41ec-9c6f-fa17b1d15e86 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:25.545849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ef4a8-465b-41ec-9c6f-fa17b1d15e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:25.547268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ef4a8-465b-41ec-9c6f-fa17b1d15e86 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:25.553119 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 121/242] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:25.554339 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2ae30-80ce-4b92-8e76-49995c5dad7f None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:25.570399 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 122/243] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:25.580432 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ef4a8-465b-41ec-9c6f-fa17b1d15e86 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:25.584176 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:25.668201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:25.677393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2ae30-80ce-4b92-8e76-49995c5dad7f None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:25.689032 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ef4a8-465b-41ec-9c6f-fa17b1d15e86 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:25.714746 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee23b7c-2034-4afb-b19c-01a48d25f019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:25.715779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee23b7c-2034-4afb-b19c-01a48d25f019 None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.716299 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee23b7c-2034-4afb-b19c-01a48d25f019 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.716855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee23b7c-2034-4afb-b19c-01a48d25f019 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.717789 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee23b7c-2034-4afb-b19c-01a48d25f019 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:25.719637 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee23b7c-2034-4afb-b19c-01a48d25f019 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:25.724822 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff57f-e85d-4342-86b6-50f679037e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:25.725502 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff57f-e85d-4342-86b6-50f679037e20 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.725773 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff57f-e85d-4342-86b6-50f679037e20 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.726039 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff57f-e85d-4342-86b6-50f679037e20 None admin] PATH_INFO: `/v3/users/d39fa904b4624167a95e95fad475d667` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.743870 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ff57f-e85d-4342-86b6-50f679037e20 None admin] RBAC: Authorizing `identity:get_user(user_id=d39fa904b4624167a95e95fad475d667)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:25.745415 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ff57f-e85d-4342-86b6-50f679037e20 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:25.747238 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 123/244] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:25 2022] GET /identity/v3/users/d39fa904b4624167a95e95fad475d667 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:25.748655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff57f-e85d-4342-86b6-50f679037e20 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:25.754812 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 122/245] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Jul 26 10:13:25 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:25.770421 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee23b7c-2034-4afb-b19c-01a48d25f019 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:25.862728 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:25.907907 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee23b7c-2034-4afb-b19c-01a48d25f019 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:25.953580 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff57f-e85d-4342-86b6-50f679037e20 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:25.954127 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467601e-4e3a-4dfd-83af-6c0725a3328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:25.955465 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467601e-4e3a-4dfd-83af-6c0725a3328b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.955979 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467601e-4e3a-4dfd-83af-6c0725a3328b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.956442 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467601e-4e3a-4dfd-83af-6c0725a3328b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.986850 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:26.044849 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467601e-4e3a-4dfd-83af-6c0725a3328b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:26.046863 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467601e-4e3a-4dfd-83af-6c0725a3328b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:26.077488 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3448efb-b2c6-40fe-b98b-09c2b4c7c907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:26.078261 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3448efb-b2c6-40fe-b98b-09c2b4c7c907 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:26.078482 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3448efb-b2c6-40fe-b98b-09c2b4c7c907 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:26.078721 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3448efb-b2c6-40fe-b98b-09c2b4c7c907 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:26.091582 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3448efb-b2c6-40fe-b98b-09c2b4c7c907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-f3448efb-b2c6-40fe-b98b-09c2b4c7c907 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:26.098084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:26.099207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:26.100506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:26.100506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:26.100506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:26.100506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:26.100506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:26.100506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:26.100506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:26.100506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:26.100506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:26.100506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:26.100506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:26.100506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:26.100506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 124/246] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:26.105176 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3448efb-b2c6-40fe-b98b-09c2b4c7c907 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:26.190381 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 123/247] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:13:26.196333 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467601e-4e3a-4dfd-83af-6c0725a3328b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:26.265099 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3448efb-b2c6-40fe-b98b-09c2b4c7c907 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:26.273952 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:26.301658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:26.321328 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969aff6-2b7a-4fcd-902a-748e476d4272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:26.322300 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969aff6-2b7a-4fcd-902a-748e476d4272 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:26.322625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969aff6-2b7a-4fcd-902a-748e476d4272 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:26.322900 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969aff6-2b7a-4fcd-902a-748e476d4272 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:26.323660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969aff6-2b7a-4fcd-902a-748e476d4272 None admin] RBAC: Adding query filter params (name=member) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:26.323963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969aff6-2b7a-4fcd-902a-748e476d4272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:26.327141 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969aff6-2b7a-4fcd-902a-748e476d4272 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:26.340092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 125/248] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:26.347593 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969aff6-2b7a-4fcd-902a-748e476d4272 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:26.357694 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467601e-4e3a-4dfd-83af-6c0725a3328b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:26.396298 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7587c1-cf96-4e0f-8b15-7a7b7e42505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:26.397363 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7587c1-cf96-4e0f-8b15-7a7b7e42505f None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:26.397833 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7587c1-cf96-4e0f-8b15-7a7b7e42505f None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:26.398292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7587c1-cf96-4e0f-8b15-7a7b7e42505f None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:26.399907 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7587c1-cf96-4e0f-8b15-7a7b7e42505f None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:26.401739 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7587c1-cf96-4e0f-8b15-7a7b7e42505f None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:26.407805 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 124/249] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:26 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:26.410647 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7587c1-cf96-4e0f-8b15-7a7b7e42505f None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:26.464505 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969aff6-2b7a-4fcd-902a-748e476d4272 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:26.507836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a91903-73d4-4f97-945e-e9189aa5e007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:26.508503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a91903-73d4-4f97-945e-e9189aa5e007 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:26.508828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a91903-73d4-4f97-945e-e9189aa5e007 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:26.509112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a91903-73d4-4f97-945e-e9189aa5e007 None admin] PATH_INFO: `/v3/users/0e12529d281140208a6b8935ceb7626e` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:26.510332 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a91903-73d4-4f97-945e-e9189aa5e007 None admin] RBAC: Authorizing `identity:get_user(user_id=0e12529d281140208a6b8935ceb7626e)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:26.511912 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a91903-73d4-4f97-945e-e9189aa5e007 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:26.513593 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 126/250] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:26 2022] GET /identity/v3/users/0e12529d281140208a6b8935ceb7626e => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:26.521843 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a91903-73d4-4f97-945e-e9189aa5e007 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:26.530030 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7587c1-cf96-4e0f-8b15-7a7b7e42505f None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:26.572017 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:26.580083 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb905ce6-967c-462c-9ad8-9383d70ca479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:26.580923 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb905ce6-967c-462c-9ad8-9383d70ca479 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:26.581295 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb905ce6-967c-462c-9ad8-9383d70ca479 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:26.581666 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb905ce6-967c-462c-9ad8-9383d70ca479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:26.582650 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb905ce6-967c-462c-9ad8-9383d70ca479 None admin] RBAC: Adding query filter params (role.id=3d8f099531114c74ad03cc59fe401ee9, scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1, user.id=d39fa904b4624167a95e95fad475d667) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:26.583068 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb905ce6-967c-462c-9ad8-9383d70ca479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:26.584801 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb905ce6-967c-462c-9ad8-9383d70ca479 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:26.592476 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 125/251] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:26 2022] GET /identity/v3/role_assignments?user.id=d39fa904b4624167a95e95fad475d667&scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1&role.id=3d8f099531114c74ad03cc59fe401ee9 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:26.592670 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:26.661677 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a91903-73d4-4f97-945e-e9189aa5e007 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:26.707056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28eaca-9fb8-45a9-baa9-e870fdcb6417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:26.707737 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28eaca-9fb8-45a9-baa9-e870fdcb6417 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:26.708021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28eaca-9fb8-45a9-baa9-e870fdcb6417 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:26.708275 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28eaca-9fb8-45a9-baa9-e870fdcb6417 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:26.709518 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28eaca-9fb8-45a9-baa9-e870fdcb6417 None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:26.711060 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28eaca-9fb8-45a9-baa9-e870fdcb6417 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:26.713190 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 127/252] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:26 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:26.719666 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb905ce6-967c-462c-9ad8-9383d70ca479 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:26.850415 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb905ce6-967c-462c-9ad8-9383d70ca479 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:26.900846 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3079de-4430-491f-98fc-4d7ca969f318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:26.902540 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3079de-4430-491f-98fc-4d7ca969f318 None admin] REQUEST_METHOD: `PUT` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:26.903262 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3079de-4430-491f-98fc-4d7ca969f318 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:26.904037 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3079de-4430-491f-98fc-4d7ca969f318 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1/users/0e12529d281140208a6b8935ceb7626e/roles/c483c855d04b4145a203e1f0eedf3c0c` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:26.908013 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3079de-4430-491f-98fc-4d7ca969f318 None admin] RBAC: Authorizing `identity:create_grant(project_id=63fd00e8a9034be59d866bb49c6a5cf1, user_id=0e12529d281140208a6b8935ceb7626e, role_id=c483c855d04b4145a203e1f0eedf3c0c)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:26.911258 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3079de-4430-491f-98fc-4d7ca969f318 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:26.939091 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 126/253] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:13:26 2022] PUT /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1/users/0e12529d281140208a6b8935ceb7626e/roles/c483c855d04b4145a203e1f0eedf3c0c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 10:13:27.313212 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474371d7-da17-46e4-9fd3-830dad6433a6 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.314171 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474371d7-da17-46e4-9fd3-830dad6433a6 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.314641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474371d7-da17-46e4-9fd3-830dad6433a6 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.316229 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 128/254] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:27.328344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838e912-f348-4f03-ab6d-003c8fc74dc1 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.329218 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838e912-f348-4f03-ab6d-003c8fc74dc1 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.329684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838e912-f348-4f03-ab6d-003c8fc74dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.355529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-5838e912-f348-4f03-ab6d-003c8fc74dc1 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:27.357152 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-5838e912-f348-4f03-ab6d-003c8fc74dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:27.398194 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:27.430502 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480252d8-5165-4f2b-99bf-72a15f02e4a8 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.431141 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480252d8-5165-4f2b-99bf-72a15f02e4a8 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.431593 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480252d8-5165-4f2b-99bf-72a15f02e4a8 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.437045 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 127/255] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:27.437651 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 129/256] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:27.438783 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bf281-a8e9-4382-93f8-469ef9db660a None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.439067 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bf281-a8e9-4382-93f8-469ef9db660a None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.439367 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bf281-a8e9-4382-93f8-469ef9db660a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.457848 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-e68bf281-a8e9-4382-93f8-469ef9db660a None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:27.459076 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-e68bf281-a8e9-4382-93f8-469ef9db660a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:27.485786 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480252d8-5165-4f2b-99bf-72a15f02e4a8 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:27.535063 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 128/257] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:27.572093 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bf281-a8e9-4382-93f8-469ef9db660a None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:27.694594 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bf281-a8e9-4382-93f8-469ef9db660a None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:27.710465 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:27.734307 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480252d8-5165-4f2b-99bf-72a15f02e4a8 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:27.734929 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d92fd6-e6eb-44de-872f-bbe78d885294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:27.735752 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d92fd6-e6eb-44de-872f-bbe78d885294 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.736154 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d92fd6-e6eb-44de-872f-bbe78d885294 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.736495 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d92fd6-e6eb-44de-872f-bbe78d885294 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.755207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:27.764615 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d92fd6-e6eb-44de-872f-bbe78d885294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-d7d92fd6-e6eb-44de-872f-bbe78d885294 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:27.770254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:27.771193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:27.772043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:27.772043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:27.772043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:27.772043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:27.772043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:27.772043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:27.772043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:27.772043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:27.772043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:27.772043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:27.772043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:27.772043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:27.775630 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 129/258] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:27.782087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d92fd6-e6eb-44de-872f-bbe78d885294 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:27.791609 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f7469-983d-445f-a924-0f07dce5a9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:27.793241 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f7469-983d-445f-a924-0f07dce5a9f3 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.793943 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f7469-983d-445f-a924-0f07dce5a9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.794751 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f7469-983d-445f-a924-0f07dce5a9f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.815722 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f7469-983d-445f-a924-0f07dce5a9f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-8e9f7469-983d-445f-a924-0f07dce5a9f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:27.825424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:27.826321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:27.829351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:27.829351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:27.829351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:27.829351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:27.829351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:27.829351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:27.829351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:27.829351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:27.829351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:27.829351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:27.829351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:27.829351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:27.831938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 130/259] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:27.837401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f7469-983d-445f-a924-0f07dce5a9f3 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:27.966405 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d92fd6-e6eb-44de-872f-bbe78d885294 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:28.043532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f7469-983d-445f-a924-0f07dce5a9f3 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:28.143802 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091e1e9-f6fe-4ae6-898f-3f22ebf33614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:28.144466 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091e1e9-f6fe-4ae6-898f-3f22ebf33614 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:28.144742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091e1e9-f6fe-4ae6-898f-3f22ebf33614 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:28.145011 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091e1e9-f6fe-4ae6-898f-3f22ebf33614 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:28.145759 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091e1e9-f6fe-4ae6-898f-3f22ebf33614 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:28.146057 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091e1e9-f6fe-4ae6-898f-3f22ebf33614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:28.147536 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091e1e9-f6fe-4ae6-898f-3f22ebf33614 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:28.167087 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 131/260] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:28.180619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091e1e9-f6fe-4ae6-898f-3f22ebf33614 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:28.240397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:28.275199 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd52a6-f121-4594-bdd2-f1acdb66b82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:28.275848 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd52a6-f121-4594-bdd2-f1acdb66b82f None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:28.276131 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd52a6-f121-4594-bdd2-f1acdb66b82f None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:28.276405 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd52a6-f121-4594-bdd2-f1acdb66b82f None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:28.277157 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd52a6-f121-4594-bdd2-f1acdb66b82f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:28.277463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd52a6-f121-4594-bdd2-f1acdb66b82f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:28.278923 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd52a6-f121-4594-bdd2-f1acdb66b82f None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:28.294377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 130/261] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:28.299822 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd52a6-f121-4594-bdd2-f1acdb66b82f None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:28.350816 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:28.374935 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091e1e9-f6fe-4ae6-898f-3f22ebf33614 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:28.476848 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833708f2-2f15-4502-af2b-135cdfe4917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:28.477863 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833708f2-2f15-4502-af2b-135cdfe4917d None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:28.478334 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833708f2-2f15-4502-af2b-135cdfe4917d None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:28.478848 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833708f2-2f15-4502-af2b-135cdfe4917d None admin] PATH_INFO: `/v3/users/91a88c523202478e9271ed8da984af53` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:28.483275 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833708f2-2f15-4502-af2b-135cdfe4917d None admin] RBAC: Authorizing `identity:get_user(user_id=91a88c523202478e9271ed8da984af53)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:28.485282 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833708f2-2f15-4502-af2b-135cdfe4917d None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:28.487225 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 132/262] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:28 2022] GET /identity/v3/users/91a88c523202478e9271ed8da984af53 => generated 283 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:28.493690 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833708f2-2f15-4502-af2b-135cdfe4917d None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:28.500549 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd52a6-f121-4594-bdd2-f1acdb66b82f None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:28.557422 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd80b9e-1a55-4847-9f3f-531a20f99386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:28.558090 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd80b9e-1a55-4847-9f3f-531a20f99386 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:28.558364 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd80b9e-1a55-4847-9f3f-531a20f99386 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:28.558659 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd80b9e-1a55-4847-9f3f-531a20f99386 None admin] PATH_INFO: `/v3/users/91a88c523202478e9271ed8da984af53` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:28.564270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd80b9e-1a55-4847-9f3f-531a20f99386 None admin] RBAC: Authorizing `identity:get_user(user_id=91a88c523202478e9271ed8da984af53)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:28.566308 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd80b9e-1a55-4847-9f3f-531a20f99386 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:28.568347 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 131/263] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:28 2022] GET /identity/v3/users/91a88c523202478e9271ed8da984af53 => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:28.577477 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd80b9e-1a55-4847-9f3f-531a20f99386 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:28.701287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833708f2-2f15-4502-af2b-135cdfe4917d None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:28.731400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:28.740862 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd80b9e-1a55-4847-9f3f-531a20f99386 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:28.742821 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:28.768555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10435b3d-9601-451d-a47e-542dd2e353e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:28.769197 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10435b3d-9601-451d-a47e-542dd2e353e1 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:28.769479 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10435b3d-9601-451d-a47e-542dd2e353e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:28.769757 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10435b3d-9601-451d-a47e-542dd2e353e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:28.807292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703604c-cbba-47b6-b79b-566c3722f381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:28.807943 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703604c-cbba-47b6-b79b-566c3722f381 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:28.808223 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703604c-cbba-47b6-b79b-566c3722f381 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:28.808494 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703604c-cbba-47b6-b79b-566c3722f381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:28.884893 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10435b3d-9601-451d-a47e-542dd2e353e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:28.886532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10435b3d-9601-451d-a47e-542dd2e353e1 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:28.947711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703604c-cbba-47b6-b79b-566c3722f381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:28.949208 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703604c-cbba-47b6-b79b-566c3722f381 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:28.994126 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 133/264] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:13:28.999515 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10435b3d-9601-451d-a47e-542dd2e353e1 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:29.038827 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:29.113138 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10435b3d-9601-451d-a47e-542dd2e353e1 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:29.130895 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:29.151936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 132/265] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:13:29.158329 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703604c-cbba-47b6-b79b-566c3722f381 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:29.158989 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c105df-7d26-4be0-8d4c-bf3613cb9c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:29.159668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c105df-7d26-4be0-8d4c-bf3613cb9c0f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:29.159947 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c105df-7d26-4be0-8d4c-bf3613cb9c0f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:29.160217 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c105df-7d26-4be0-8d4c-bf3613cb9c0f None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:29.165683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c105df-7d26-4be0-8d4c-bf3613cb9c0f None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:29.165683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c105df-7d26-4be0-8d4c-bf3613cb9c0f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:29.166014 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 134/266] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:28 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:29.172576 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c105df-7d26-4be0-8d4c-bf3613cb9c0f None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:29.258105 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:29.283633 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c105df-7d26-4be0-8d4c-bf3613cb9c0f None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:29.328203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48ddd9-aa2e-41ba-a601-4f6217e35431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:29.328847 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48ddd9-aa2e-41ba-a601-4f6217e35431 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:29.329127 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48ddd9-aa2e-41ba-a601-4f6217e35431 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:29.329400 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48ddd9-aa2e-41ba-a601-4f6217e35431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:29.331457 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48ddd9-aa2e-41ba-a601-4f6217e35431 None admin] RBAC: Adding query filter params (role.id=7d88b748366a42929784db05d53fe473, scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1, user.id=91a88c523202478e9271ed8da984af53) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:29.331772 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48ddd9-aa2e-41ba-a601-4f6217e35431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:29.333258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48ddd9-aa2e-41ba-a601-4f6217e35431 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:29.353394 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 135/267] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:29 2022] GET /identity/v3/role_assignments?user.id=91a88c523202478e9271ed8da984af53&scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1&role.id=7d88b748366a42929784db05d53fe473 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:29.364145 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703604c-cbba-47b6-b79b-566c3722f381 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:29.416892 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e2b11-431b-4768-b1c3-643ccacfae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:29.417583 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e2b11-431b-4768-b1c3-643ccacfae86 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:29.417866 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e2b11-431b-4768-b1c3-643ccacfae86 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:29.418141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e2b11-431b-4768-b1c3-643ccacfae86 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:29.419441 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e2b11-431b-4768-b1c3-643ccacfae86 None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:29.421130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e2b11-431b-4768-b1c3-643ccacfae86 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:29.422909 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 133/268] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:29 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:29.429264 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48ddd9-aa2e-41ba-a601-4f6217e35431 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:29.564772 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48ddd9-aa2e-41ba-a601-4f6217e35431 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:29.606938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d920629-32cc-4e63-bd63-fedad66953cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:29.607590 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d920629-32cc-4e63-bd63-fedad66953cd None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:29.608054 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d920629-32cc-4e63-bd63-fedad66953cd None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:29.608331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d920629-32cc-4e63-bd63-fedad66953cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:29.609163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d920629-32cc-4e63-bd63-fedad66953cd None admin] RBAC: Adding query filter params (role.id=2ae24c72c8264d0ba34cbe573083cc33, scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1, user.id=91a88c523202478e9271ed8da984af53) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:29.609473 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d920629-32cc-4e63-bd63-fedad66953cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:29.611078 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d920629-32cc-4e63-bd63-fedad66953cd None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:29.622592 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 136/269] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:29 2022] GET /identity/v3/role_assignments?user.id=91a88c523202478e9271ed8da984af53&scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1&role.id=2ae24c72c8264d0ba34cbe573083cc33 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:29.748671 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8fe05-7589-4d4d-a19b-596d13a9f88a None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:29.749002 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8fe05-7589-4d4d-a19b-596d13a9f88a None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:29.749234 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8fe05-7589-4d4d-a19b-596d13a9f88a None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:29.751074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 134/270] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:29.761750 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd5ca-722a-4ef3-8075-cfb01426c188 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:29.762057 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd5ca-722a-4ef3-8075-cfb01426c188 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:29.762315 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd5ca-722a-4ef3-8075-cfb01426c188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:29.770534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:29.786963 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f9c41-0560-4b9b-971d-01f948419914 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:29.787305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f9c41-0560-4b9b-971d-01f948419914 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:29.787519 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f9c41-0560-4b9b-971d-01f948419914 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:29.789300 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 135/271] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:29.790533 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-5c6dd5ca-722a-4ef3-8075-cfb01426c188 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:29.791798 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-5c6dd5ca-722a-4ef3-8075-cfb01426c188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:29.804159 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a992a9-1754-401b-bd6f-f90967b1bee9 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:29.804461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a992a9-1754-401b-bd6f-f90967b1bee9 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:29.804709 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a992a9-1754-401b-bd6f-f90967b1bee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:29.832075 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-a1a992a9-1754-401b-bd6f-f90967b1bee9 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:29.833199 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-a1a992a9-1754-401b-bd6f-f90967b1bee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:29.868138 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 137/272] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:29.898133 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd5ca-722a-4ef3-8075-cfb01426c188 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:29.921883 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:29.937788 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 136/273] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:29.971708 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a992a9-1754-401b-bd6f-f90967b1bee9 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:30.056513 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd5ca-722a-4ef3-8075-cfb01426c188 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:30.093906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe6ac1-85ab-45d6-b45a-9a59e4a0f6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:30.094827 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe6ac1-85ab-45d6-b45a-9a59e4a0f6dd None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.095249 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe6ac1-85ab-45d6-b45a-9a59e4a0f6dd None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.095772 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe6ac1-85ab-45d6-b45a-9a59e4a0f6dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.098222 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:30.107216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a992a9-1754-401b-bd6f-f90967b1bee9 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:30.121800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe6ac1-85ab-45d6-b45a-9a59e4a0f6dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-3afe6ac1-85ab-45d6-b45a-9a59e4a0f6dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:30.127640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:30.128732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:30.129686 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:30.129686 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:30.129686 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:30.129686 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:30.129686 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:30.129686 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:30.129686 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:30.129686 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:30.129686 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:30.129686 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:30.129686 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:30.129686 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:30.132082 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 138/274] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:30.139592 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe6ac1-85ab-45d6-b45a-9a59e4a0f6dd None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:30.143241 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e901d3a-c21a-48c0-8c10-d607e2e859da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:30.144018 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e901d3a-c21a-48c0-8c10-d607e2e859da None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.144321 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e901d3a-c21a-48c0-8c10-d607e2e859da None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.144654 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e901d3a-c21a-48c0-8c10-d607e2e859da None admin] PATH_INFO: `/v3/domains/default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.145808 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e901d3a-c21a-48c0-8c10-d607e2e859da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:30.147292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e901d3a-c21a-48c0-8c10-d607e2e859da None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:30.149193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 137/275] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:30.155702 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e901d3a-c21a-48c0-8c10-d607e2e859da None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:30.218625 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:30.248893 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe6ac1-85ab-45d6-b45a-9a59e4a0f6dd None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:30.263302 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e901d3a-c21a-48c0-8c10-d607e2e859da None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:30.287569 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e3f2f-805c-4e9e-a884-2195c1d0cc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:30.288489 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e3f2f-805c-4e9e-a884-2195c1d0cc51 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.289044 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e3f2f-805c-4e9e-a884-2195c1d0cc51 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.289516 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e3f2f-805c-4e9e-a884-2195c1d0cc51 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.290858 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e3f2f-805c-4e9e-a884-2195c1d0cc51 None admin] RBAC: Adding query filter params (name=member) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:30.291334 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e3f2f-805c-4e9e-a884-2195c1d0cc51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:30.293124 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e3f2f-805c-4e9e-a884-2195c1d0cc51 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:30.298151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae50277-ed22-4326-979f-f3267b61d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:30.298792 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae50277-ed22-4326-979f-f3267b61d245 None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.299070 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae50277-ed22-4326-979f-f3267b61d245 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.299343 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae50277-ed22-4326-979f-f3267b61d245 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.300039 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae50277-ed22-4326-979f-f3267b61d245 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:30.301476 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae50277-ed22-4326-979f-f3267b61d245 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:30.303184 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 139/276] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:30.304754 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d97e0c-007b-43ae-be00-3fa4890e106c None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.305203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d97e0c-007b-43ae-be00-3fa4890e106c None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.305631 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d97e0c-007b-43ae-be00-3fa4890e106c None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.307283 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 140/277] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:30.308307 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d97e0c-007b-43ae-be00-3fa4890e106c None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:30.337359 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 138/278] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Jul 26 10:13:30 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:13:30.337359 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa93f6b-bd6c-4a1a-8d42-57e18c72224f None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.337359 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa93f6b-bd6c-4a1a-8d42-57e18c72224f None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.337359 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa93f6b-bd6c-4a1a-8d42-57e18c72224f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.359817 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-4aa93f6b-bd6c-4a1a-8d42-57e18c72224f None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:30.361469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-4aa93f6b-bd6c-4a1a-8d42-57e18c72224f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:30.383205 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:30.439253 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d97e0c-007b-43ae-be00-3fa4890e106c None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:30.487399 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 139/279] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:30.500303 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503be435-b069-4416-80dd-a184001fdefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:30.500993 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503be435-b069-4416-80dd-a184001fdefc None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.501356 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503be435-b069-4416-80dd-a184001fdefc None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.501615 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503be435-b069-4416-80dd-a184001fdefc None admin] PATH_INFO: `/v3/users/b0f40b9e80ca4c2d93ac2ba52069c9ac` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.511799 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa93f6b-bd6c-4a1a-8d42-57e18c72224f None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:30.525363 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503be435-b069-4416-80dd-a184001fdefc None admin] RBAC: Authorizing `identity:get_user(user_id=b0f40b9e80ca4c2d93ac2ba52069c9ac)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:30.527902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503be435-b069-4416-80dd-a184001fdefc None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:30.530654 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 141/280] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:30 2022] GET /identity/v3/users/b0f40b9e80ca4c2d93ac2ba52069c9ac => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:30.536167 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503be435-b069-4416-80dd-a184001fdefc None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:30.574455 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:30.650958 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa93f6b-bd6c-4a1a-8d42-57e18c72224f None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:30.676049 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503be435-b069-4416-80dd-a184001fdefc None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:30.694747 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:30.700215 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81370de1-7693-4160-b2d4-b6397e351b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:30.701188 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81370de1-7693-4160-b2d4-b6397e351b69 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.701729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81370de1-7693-4160-b2d4-b6397e351b69 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.702958 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81370de1-7693-4160-b2d4-b6397e351b69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.720091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adf4e5-7dee-4fdc-9235-508f0f7bc339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:30.720728 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adf4e5-7dee-4fdc-9235-508f0f7bc339 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.720927 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81370de1-7693-4160-b2d4-b6397e351b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:30.721103 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adf4e5-7dee-4fdc-9235-508f0f7bc339 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.721380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adf4e5-7dee-4fdc-9235-508f0f7bc339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.722180 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adf4e5-7dee-4fdc-9235-508f0f7bc339 None admin] RBAC: Adding query filter params (role.id=c483c855d04b4145a203e1f0eedf3c0c, user.id=b0f40b9e80ca4c2d93ac2ba52069c9ac, scope.system=all) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:30.722538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adf4e5-7dee-4fdc-9235-508f0f7bc339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:30.723991 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adf4e5-7dee-4fdc-9235-508f0f7bc339 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-81370de1-7693-4160-b2d4-b6397e351b69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:30.726254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:30.727203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:30.728009 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:30.728009 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:30.728009 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:30.728009 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:30.728009 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:30.728009 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:30.728009 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:30.728009 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:30.728009 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:30.728009 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:30.728009 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:30.728009 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:30.730550 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 140/281] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:30.732539 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730cc84-cb60-48ff-8cc2-ac4c24fb02c9 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.732889 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730cc84-cb60-48ff-8cc2-ac4c24fb02c9 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.733837 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730cc84-cb60-48ff-8cc2-ac4c24fb02c9 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.734885 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 141/282] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:30.735487 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730cc84-cb60-48ff-8cc2-ac4c24fb02c9 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:30.735947 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 142/283] 10.222.0.60 () {56 vars in 1308 bytes} [Tue Jul 26 10:13:30 2022] GET /identity/v3/role_assignments?user.id=b0f40b9e80ca4c2d93ac2ba52069c9ac&scope.system=all&role.id=c483c855d04b4145a203e1f0eedf3c0c => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:30.740878 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca9e52-b04f-4ecb-9e94-30663474cc98 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.741228 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca9e52-b04f-4ecb-9e94-30663474cc98 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.741456 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca9e52-b04f-4ecb-9e94-30663474cc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.761425 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-9bca9e52-b04f-4ecb-9e94-30663474cc98 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:30.762696 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-9bca9e52-b04f-4ecb-9e94-30663474cc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:30.841648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 143/284] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:30.859740 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730cc84-cb60-48ff-8cc2-ac4c24fb02c9 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:30.862604 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:30.866653 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca9e52-b04f-4ecb-9e94-30663474cc98 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:30.900035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfef810-045c-4d3d-afce-fec633d31e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:30.900667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfef810-045c-4d3d-afce-fec633d31e58 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.901093 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfef810-045c-4d3d-afce-fec633d31e58 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.901304 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfef810-045c-4d3d-afce-fec633d31e58 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.902143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfef810-045c-4d3d-afce-fec633d31e58 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:30.902458 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfef810-045c-4d3d-afce-fec633d31e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:30.903887 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfef810-045c-4d3d-afce-fec633d31e58 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:30.914013 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 142/285] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:30.920312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfef810-045c-4d3d-afce-fec633d31e58 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:30.980188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca9e52-b04f-4ecb-9e94-30663474cc98 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:30.991678 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:31.041464 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc0bcf-6e35-4686-9438-b4e59399520e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:31.042229 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc0bcf-6e35-4686-9438-b4e59399520e None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:31.042600 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc0bcf-6e35-4686-9438-b4e59399520e None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:31.042933 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc0bcf-6e35-4686-9438-b4e59399520e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:31.062798 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfef810-045c-4d3d-afce-fec633d31e58 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:31.063857 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc0bcf-6e35-4686-9438-b4e59399520e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-84fc0bcf-6e35-4686-9438-b4e59399520e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:31.069789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:31.070979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:31.071946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:31.071946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:31.071946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:31.071946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:31.071946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:31.071946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:31.071946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:31.071946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:31.071946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:31.071946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:31.071946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:31.071946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:31.084300 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 144/286] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:31.087986 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc0bcf-6e35-4686-9438-b4e59399520e None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:31.140468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4fc08-7d01-4dd3-8f0e-fb2317b17e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:31.141236 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4fc08-7d01-4dd3-8f0e-fb2317b17e83 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:31.141585 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4fc08-7d01-4dd3-8f0e-fb2317b17e83 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:31.141927 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4fc08-7d01-4dd3-8f0e-fb2317b17e83 None admin] PATH_INFO: `/v3/users/d39fa904b4624167a95e95fad475d667` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:31.143486 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4fc08-7d01-4dd3-8f0e-fb2317b17e83 None admin] RBAC: Authorizing `identity:get_user(user_id=d39fa904b4624167a95e95fad475d667)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:31.146549 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4fc08-7d01-4dd3-8f0e-fb2317b17e83 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:31.149261 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 143/287] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:30 2022] GET /identity/v3/users/d39fa904b4624167a95e95fad475d667 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:31.159616 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4fc08-7d01-4dd3-8f0e-fb2317b17e83 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:31.230793 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:31.290578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc0bcf-6e35-4686-9438-b4e59399520e None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:31.327051 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4fc08-7d01-4dd3-8f0e-fb2317b17e83 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:31.388100 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3cee1-93b1-4b58-a0b3-97d80127ab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:31.388740 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3cee1-93b1-4b58-a0b3-97d80127ab6e None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:31.389095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3cee1-93b1-4b58-a0b3-97d80127ab6e None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:31.389369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3cee1-93b1-4b58-a0b3-97d80127ab6e None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:31.390111 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3cee1-93b1-4b58-a0b3-97d80127ab6e None admin] RBAC: Adding query filter params (name=member) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:31.390544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3cee1-93b1-4b58-a0b3-97d80127ab6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:31.391960 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3cee1-93b1-4b58-a0b3-97d80127ab6e None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:31.405816 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 145/288] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:31.407334 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3cee1-93b1-4b58-a0b3-97d80127ab6e None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:31.435789 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be645e71-67ff-41fd-87d1-0aced798d964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:31.436378 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be645e71-67ff-41fd-87d1-0aced798d964 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:31.436653 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be645e71-67ff-41fd-87d1-0aced798d964 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:31.436932 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be645e71-67ff-41fd-87d1-0aced798d964 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:31.438347 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be645e71-67ff-41fd-87d1-0aced798d964 None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:31.439977 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be645e71-67ff-41fd-87d1-0aced798d964 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:31.440606 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:31.443153 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 144/289] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:31 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:31.450079 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be645e71-67ff-41fd-87d1-0aced798d964 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:31.522624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3cee1-93b1-4b58-a0b3-97d80127ab6e None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:31.561235 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09d1ec-3010-4de3-97e0-bfeae0861e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:31.561844 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09d1ec-3010-4de3-97e0-bfeae0861e73 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:31.562124 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09d1ec-3010-4de3-97e0-bfeae0861e73 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:31.562398 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09d1ec-3010-4de3-97e0-bfeae0861e73 None admin] PATH_INFO: `/v3/users/0e12529d281140208a6b8935ceb7626e` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:31.565326 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09d1ec-3010-4de3-97e0-bfeae0861e73 None admin] RBAC: Authorizing `identity:get_user(user_id=0e12529d281140208a6b8935ceb7626e)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:31.567276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09d1ec-3010-4de3-97e0-bfeae0861e73 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:31.573280 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 146/290] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:31 2022] GET /identity/v3/users/0e12529d281140208a6b8935ceb7626e => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:31.574699 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09d1ec-3010-4de3-97e0-bfeae0861e73 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:31.669866 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be645e71-67ff-41fd-87d1-0aced798d964 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:31.672364 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:31.680987 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:31.684978 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09d1ec-3010-4de3-97e0-bfeae0861e73 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:31.719989 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b5a4d-6aa1-4884-b378-ed171fa2534e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:31.720600 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b5a4d-6aa1-4884-b378-ed171fa2534e None admin] REQUEST_METHOD: `PUT` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:31.720874 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b5a4d-6aa1-4884-b378-ed171fa2534e None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:31.721145 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b5a4d-6aa1-4884-b378-ed171fa2534e None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1/users/d39fa904b4624167a95e95fad475d667/roles/3d8f099531114c74ad03cc59fe401ee9` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:31.724535 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b5a4d-6aa1-4884-b378-ed171fa2534e None admin] RBAC: Authorizing `identity:create_grant(project_id=63fd00e8a9034be59d866bb49c6a5cf1, user_id=d39fa904b4624167a95e95fad475d667, role_id=3d8f099531114c74ad03cc59fe401ee9)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:31.727533 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b5a4d-6aa1-4884-b378-ed171fa2534e None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:31.752580 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 145/291] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:13:31 2022] PUT /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1/users/d39fa904b4624167a95e95fad475d667/roles/3d8f099531114c74ad03cc59fe401ee9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:31.763923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557de517-abb2-4013-b46e-ac1c511662ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:31.764618 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de517-abb2-4013-b46e-ac1c511662ed None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:31.764896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de517-abb2-4013-b46e-ac1c511662ed None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:31.765214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de517-abb2-4013-b46e-ac1c511662ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:31.847921 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557de517-abb2-4013-b46e-ac1c511662ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:31.849413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557de517-abb2-4013-b46e-ac1c511662ed None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:31.975727 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:31.982984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 147/292] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:31.991719 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b5a4d-6aa1-4884-b378-ed171fa2534e None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:32.159667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b5a4d-6aa1-4884-b378-ed171fa2534e None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:32.216011 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d096b2-c0ae-4708-b1a5-c62cda33a7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:32.217008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d096b2-c0ae-4708-b1a5-c62cda33a7fa None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:32.217397 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d096b2-c0ae-4708-b1a5-c62cda33a7fa None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:32.217804 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d096b2-c0ae-4708-b1a5-c62cda33a7fa None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:32.220088 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d096b2-c0ae-4708-b1a5-c62cda33a7fa None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:32.222723 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d096b2-c0ae-4708-b1a5-c62cda33a7fa None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:32.226727 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 146/293] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:31 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:32.235687 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557de517-abb2-4013-b46e-ac1c511662ed None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:32.384215 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557de517-abb2-4013-b46e-ac1c511662ed None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:32.423359 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea10c5-c991-4a39-85d6-9a3d08fe3a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:32.424012 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea10c5-c991-4a39-85d6-9a3d08fe3a14 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:32.424290 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea10c5-c991-4a39-85d6-9a3d08fe3a14 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:32.424562 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea10c5-c991-4a39-85d6-9a3d08fe3a14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:32.425374 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea10c5-c991-4a39-85d6-9a3d08fe3a14 None admin] RBAC: Adding query filter params (role.id=c483c855d04b4145a203e1f0eedf3c0c, scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1, user.id=0e12529d281140208a6b8935ceb7626e) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:32.425687 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea10c5-c991-4a39-85d6-9a3d08fe3a14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:32.427217 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea10c5-c991-4a39-85d6-9a3d08fe3a14 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:32.438584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 148/294] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:32 2022] GET /identity/v3/role_assignments?user.id=0e12529d281140208a6b8935ceb7626e&scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1&role.id=c483c855d04b4145a203e1f0eedf3c0c => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:33.318142 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de56f0-c4e4-4811-b695-cd599520921c None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.318699 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de56f0-c4e4-4811-b695-cd599520921c None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.318699 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de56f0-c4e4-4811-b695-cd599520921c None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.320292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 147/295] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:33.326467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d31295-a940-4015-8715-477984e5c2c5 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.327032 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d31295-a940-4015-8715-477984e5c2c5 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.327032 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d31295-a940-4015-8715-477984e5c2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.346815 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-38d31295-a940-4015-8715-477984e5c2c5 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:33.348055 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-38d31295-a940-4015-8715-477984e5c2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:33.398941 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c65b8-c30d-4634-9f97-a7fc00f91b8f None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.399260 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c65b8-c30d-4634-9f97-a7fc00f91b8f None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.399819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c65b8-c30d-4634-9f97-a7fc00f91b8f None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.401719 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 148/296] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:33.412121 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929f440-eb1c-47b6-8ad3-6613b9db3352 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.413221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929f440-eb1c-47b6-8ad3-6613b9db3352 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.413600 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929f440-eb1c-47b6-8ad3-6613b9db3352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.417262 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:33.430278 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 149/297] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:33.442190 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-8929f440-eb1c-47b6-8ad3-6613b9db3352 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:33.443440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-8929f440-eb1c-47b6-8ad3-6613b9db3352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:33.456101 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d31295-a940-4015-8715-477984e5c2c5 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:33.479871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:33.546570 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 149/298] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:33.567535 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d31295-a940-4015-8715-477984e5c2c5 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:33.567804 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929f440-eb1c-47b6-8ad3-6613b9db3352 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:33.612158 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83ab2e-e475-4f96-bc21-94c7da354fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:33.613235 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83ab2e-e475-4f96-bc21-94c7da354fbd None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.613728 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83ab2e-e475-4f96-bc21-94c7da354fbd None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.614192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83ab2e-e475-4f96-bc21-94c7da354fbd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.642510 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83ab2e-e475-4f96-bc21-94c7da354fbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-aa83ab2e-e475-4f96-bc21-94c7da354fbd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:33.650009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:33.651218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:33.652199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:33.652199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:33.652199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:33.652199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:33.652199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:33.652199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:33.652199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:33.652199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:33.652199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:33.652199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:33.652199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:33.652199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:33.654581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 150/299] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:33.668261 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83ab2e-e475-4f96-bc21-94c7da354fbd None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:33.731276 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929f440-eb1c-47b6-8ad3-6613b9db3352 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:33.752013 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:33.773437 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572912fe-7c80-45f3-8060-d934457e7c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:33.774859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572912fe-7c80-45f3-8060-d934457e7c10 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.774859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572912fe-7c80-45f3-8060-d934457e7c10 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.774859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572912fe-7c80-45f3-8060-d934457e7c10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.776025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572912fe-7c80-45f3-8060-d934457e7c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:33.777482 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572912fe-7c80-45f3-8060-d934457e7c10 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:33.779215 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 150/300] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:33.785729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470804b7-5a30-4785-a9d0-998047154217 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.786038 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470804b7-5a30-4785-a9d0-998047154217 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.786332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470804b7-5a30-4785-a9d0-998047154217 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.792067 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 151/301] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:33 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:33.792944 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470804b7-5a30-4785-a9d0-998047154217 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:33.813953 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83ab2e-e475-4f96-bc21-94c7da354fbd None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:33.829024 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:33.856984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10829692-a79c-4b7a-8c5c-891af0b3862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:33.857684 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10829692-a79c-4b7a-8c5c-891af0b3862a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.857963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10829692-a79c-4b7a-8c5c-891af0b3862a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.858230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10829692-a79c-4b7a-8c5c-891af0b3862a None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.858983 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10829692-a79c-4b7a-8c5c-891af0b3862a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:33.859283 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10829692-a79c-4b7a-8c5c-891af0b3862a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:33.860676 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10829692-a79c-4b7a-8c5c-891af0b3862a None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:33.871715 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 151/302] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:33.872985 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f5377-1aff-4e27-9dd1-5275dfdc8e97 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.873321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f5377-1aff-4e27-9dd1-5275dfdc8e97 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.873593 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f5377-1aff-4e27-9dd1-5275dfdc8e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.892671 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-f48f5377-1aff-4e27-9dd1-5275dfdc8e97 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:33.894013 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-f48f5377-1aff-4e27-9dd1-5275dfdc8e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:33.920655 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470804b7-5a30-4785-a9d0-998047154217 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:33.962476 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f81d7-3e5c-4f66-95eb-fed812b3999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:33.963148 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f81d7-3e5c-4f66-95eb-fed812b3999c None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.963431 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f81d7-3e5c-4f66-95eb-fed812b3999c None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.963700 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f81d7-3e5c-4f66-95eb-fed812b3999c None admin] PATH_INFO: `/v3/groups` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.964366 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f81d7-3e5c-4f66-95eb-fed812b3999c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:33.965815 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f81d7-3e5c-4f66-95eb-fed812b3999c None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:33.987398 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 152/303] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:33.988834 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f5377-1aff-4e27-9dd1-5275dfdc8e97 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:34.003260 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 152/304] 10.222.0.60 () {60 vars in 1134 bytes} [Tue Jul 26 10:13:33 2022] POST /identity/v3/groups => generated 229 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:34.009250 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f81d7-3e5c-4f66-95eb-fed812b3999c None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:34.136942 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:34.177925 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:34.197898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f81d7-3e5c-4f66-95eb-fed812b3999c None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:34.221065 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f5377-1aff-4e27-9dd1-5275dfdc8e97 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:34.240483 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8a389-00f6-4f10-850e-dfaf096f0191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:34.241495 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8a389-00f6-4f10-850e-dfaf096f0191 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:34.241950 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8a389-00f6-4f10-850e-dfaf096f0191 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:34.242394 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8a389-00f6-4f10-850e-dfaf096f0191 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:34.255021 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8a389-00f6-4f10-850e-dfaf096f0191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:34.260820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f27ae2-6c4b-4bd9-9624-c94b7cbb08c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-05e8a389-00f6-4f10-850e-dfaf096f0191 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:34.261435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:34.262282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:34.263126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:34.263126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:34.263126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:34.263126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:34.263126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:34.263126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:34.263126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:34.263126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:34.263126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:34.263126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:34.263126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:34.263126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:34.263958 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f27ae2-6c4b-4bd9-9624-c94b7cbb08c3 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:34.263958 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f27ae2-6c4b-4bd9-9624-c94b7cbb08c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:34.263958 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f27ae2-6c4b-4bd9-9624-c94b7cbb08c3 None admin] PATH_INFO: `/v3/users/72b3c3b0cae54e92952b920f5d1c773e` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:34.266104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 153/305] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:34.272414 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8a389-00f6-4f10-850e-dfaf096f0191 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:34.283669 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f27ae2-6c4b-4bd9-9624-c94b7cbb08c3 None admin] RBAC: Authorizing `identity:get_user(user_id=72b3c3b0cae54e92952b920f5d1c773e)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:34.285300 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f27ae2-6c4b-4bd9-9624-c94b7cbb08c3 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:34.288275 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 153/306] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:33 2022] GET /identity/v3/users/72b3c3b0cae54e92952b920f5d1c773e => generated 293 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:34.297339 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f27ae2-6c4b-4bd9-9624-c94b7cbb08c3 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:34.436979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f27ae2-6c4b-4bd9-9624-c94b7cbb08c3 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:34.439482 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:34.445145 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8a389-00f6-4f10-850e-dfaf096f0191 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:34.478382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c790c7-1eee-4e0b-9abb-c08724750ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:34.479515 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c790c7-1eee-4e0b-9abb-c08724750ca2 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:34.479993 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c790c7-1eee-4e0b-9abb-c08724750ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:34.480457 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c790c7-1eee-4e0b-9abb-c08724750ca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:34.481472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c790c7-1eee-4e0b-9abb-c08724750ca2 None admin] RBAC: Adding query filter params (role.id=3d8f099531114c74ad03cc59fe401ee9, user.id=72b3c3b0cae54e92952b920f5d1c773e, scope.system=all) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:34.481984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c790c7-1eee-4e0b-9abb-c08724750ca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:34.483787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c790c7-1eee-4e0b-9abb-c08724750ca2 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:34.484376 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948b129-227a-4be1-b422-1654d30946cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:34.485021 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948b129-227a-4be1-b422-1654d30946cb None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:34.485302 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948b129-227a-4be1-b422-1654d30946cb None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:34.485577 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948b129-227a-4be1-b422-1654d30946cb None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:34.486321 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948b129-227a-4be1-b422-1654d30946cb None admin] RBAC: Adding query filter params (name=member) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:34.486679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948b129-227a-4be1-b422-1654d30946cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:34.488448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948b129-227a-4be1-b422-1654d30946cb None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:34.491733 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 154/307] 10.222.0.60 () {56 vars in 1308 bytes} [Tue Jul 26 10:13:34 2022] GET /identity/v3/role_assignments?user.id=72b3c3b0cae54e92952b920f5d1c773e&scope.system=all&role.id=3d8f099531114c74ad03cc59fe401ee9 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:34.502520 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 154/308] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:34.504192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c790c7-1eee-4e0b-9abb-c08724750ca2 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:34.579694 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b21a2-e9ba-4d60-8483-8d8d71206f5e None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:34.580073 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b21a2-e9ba-4d60-8483-8d8d71206f5e None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:34.580414 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b21a2-e9ba-4d60-8483-8d8d71206f5e None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:34.582298 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 155/309] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:34.588204 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da1df6-7653-498c-8223-7b4a6d41c13e None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:34.588524 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da1df6-7653-498c-8223-7b4a6d41c13e None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:34.588764 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da1df6-7653-498c-8223-7b4a6d41c13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:34.611047 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-b2da1df6-7653-498c-8223-7b4a6d41c13e None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:34.612318 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-b2da1df6-7653-498c-8223-7b4a6d41c13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:34.615973 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:34.637565 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c790c7-1eee-4e0b-9abb-c08724750ca2 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:34.697157 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5418c0-beec-48e7-bfd8-dac42133095a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:34.697157 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5418c0-beec-48e7-bfd8-dac42133095a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:34.697157 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5418c0-beec-48e7-bfd8-dac42133095a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:34.697157 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5418c0-beec-48e7-bfd8-dac42133095a None admin] PATH_INFO: `/v3/users/b0f40b9e80ca4c2d93ac2ba52069c9ac` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:34.698720 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5418c0-beec-48e7-bfd8-dac42133095a None admin] RBAC: Authorizing `identity:get_user(user_id=b0f40b9e80ca4c2d93ac2ba52069c9ac)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:34.699847 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5418c0-beec-48e7-bfd8-dac42133095a None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:34.701844 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 155/310] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:34 2022] GET /identity/v3/users/b0f40b9e80ca4c2d93ac2ba52069c9ac => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:34.708275 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5418c0-beec-48e7-bfd8-dac42133095a None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:34.729199 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 156/311] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:34.749497 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da1df6-7653-498c-8223-7b4a6d41c13e None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:34.766005 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:34.855220 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5418c0-beec-48e7-bfd8-dac42133095a None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:34.895372 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976fc2e-a1db-490a-abb8-a02336aba830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:34.896438 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976fc2e-a1db-490a-abb8-a02336aba830 None admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:34.896993 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976fc2e-a1db-490a-abb8-a02336aba830 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:34.897558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976fc2e-a1db-490a-abb8-a02336aba830 None admin] PATH_INFO: `/v3/system/users/b0f40b9e80ca4c2d93ac2ba52069c9ac/roles/c483c855d04b4145a203e1f0eedf3c0c` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:34.899465 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976fc2e-a1db-490a-abb8-a02336aba830 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b0f40b9e80ca4c2d93ac2ba52069c9ac, role_id=c483c855d04b4145a203e1f0eedf3c0c)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:34.901361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976fc2e-a1db-490a-abb8-a02336aba830 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:34.904059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da1df6-7653-498c-8223-7b4a6d41c13e None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:34.917103 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 156/312] 10.222.0.60 () {58 vars in 1334 bytes} [Tue Jul 26 10:13:34 2022] PUT /identity/v3/system/users/b0f40b9e80ca4c2d93ac2ba52069c9ac/roles/c483c855d04b4145a203e1f0eedf3c0c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 10:13:34.958907 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b7f87-5673-4f86-b4d6-bdaf72016fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:34.960053 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b7f87-5673-4f86-b4d6-bdaf72016fdf None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:34.960589 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b7f87-5673-4f86-b4d6-bdaf72016fdf None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:34.961122 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b7f87-5673-4f86-b4d6-bdaf72016fdf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:34.972031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:34.977273 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b7f87-5673-4f86-b4d6-bdaf72016fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-228b7f87-5673-4f86-b4d6-bdaf72016fdf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:34.984597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:34.985606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:34.986385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:34.986385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:34.986385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:34.986385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:34.986385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:34.986385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:34.986385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:34.986385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:34.986385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:34.986385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:34.986385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:34.986385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:34.989527 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 157/313] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:34.996657 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976fc2e-a1db-490a-abb8-a02336aba830 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:35.137760 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:35.142709 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976fc2e-a1db-490a-abb8-a02336aba830 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:35.181167 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f4623-f81d-46a0-a438-58ad855ee8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:35.181803 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f4623-f81d-46a0-a438-58ad855ee8a0 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:35.182078 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f4623-f81d-46a0-a438-58ad855ee8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:35.182350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f4623-f81d-46a0-a438-58ad855ee8a0 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:35.183118 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f4623-f81d-46a0-a438-58ad855ee8a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:35.183441 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f4623-f81d-46a0-a438-58ad855ee8a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:35.184846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f4623-f81d-46a0-a438-58ad855ee8a0 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:35.194624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 157/314] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:35.201901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b7f87-5673-4f86-b4d6-bdaf72016fdf None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:35.314151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b7f87-5673-4f86-b4d6-bdaf72016fdf None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:35.355299 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d3838-5ad2-44ca-988c-059206fdc198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:35.355966 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d3838-5ad2-44ca-988c-059206fdc198 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:35.356241 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d3838-5ad2-44ca-988c-059206fdc198 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:35.356508 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d3838-5ad2-44ca-988c-059206fdc198 None admin] PATH_INFO: `/v3/users/d39fa904b4624167a95e95fad475d667` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:35.357921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d3838-5ad2-44ca-988c-059206fdc198 None admin] RBAC: Authorizing `identity:get_user(user_id=d39fa904b4624167a95e95fad475d667)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:35.359483 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d3838-5ad2-44ca-988c-059206fdc198 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:35.361500 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 158/315] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:35 2022] GET /identity/v3/users/d39fa904b4624167a95e95fad475d667 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:35.367580 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f4623-f81d-46a0-a438-58ad855ee8a0 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:35.517416 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f4623-f81d-46a0-a438-58ad855ee8a0 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:35.557365 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac50db7-c5c9-4b6f-a372-8d1b4cd35d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:35.558416 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50db7-c5c9-4b6f-a372-8d1b4cd35d3c None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:35.558931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50db7-c5c9-4b6f-a372-8d1b4cd35d3c None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:35.559412 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50db7-c5c9-4b6f-a372-8d1b4cd35d3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:35.599293 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:35.643394 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac50db7-c5c9-4b6f-a372-8d1b4cd35d3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:35.645088 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac50db7-c5c9-4b6f-a372-8d1b4cd35d3c None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:35.759015 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 158/316] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:35.764901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d3838-5ad2-44ca-988c-059206fdc198 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:35.841025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:35.880702 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d3838-5ad2-44ca-988c-059206fdc198 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:35.921139 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bea0ce-b764-4d0d-a05c-cce32ba8e6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:35.921807 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bea0ce-b764-4d0d-a05c-cce32ba8e6b3 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:35.922087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bea0ce-b764-4d0d-a05c-cce32ba8e6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:35.922358 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bea0ce-b764-4d0d-a05c-cce32ba8e6b3 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:35.923592 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bea0ce-b764-4d0d-a05c-cce32ba8e6b3 None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:35.925145 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bea0ce-b764-4d0d-a05c-cce32ba8e6b3 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:35.927207 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 159/317] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:35 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:35.935002 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac50db7-c5c9-4b6f-a372-8d1b4cd35d3c None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:35.994489 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:36.038509 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac50db7-c5c9-4b6f-a372-8d1b4cd35d3c None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:36.076832 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65524068-e2b9-46a1-b547-89388fb31c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:36.077460 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65524068-e2b9-46a1-b547-89388fb31c42 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.077732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65524068-e2b9-46a1-b547-89388fb31c42 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.077996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65524068-e2b9-46a1-b547-89388fb31c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.078821 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65524068-e2b9-46a1-b547-89388fb31c42 None admin] RBAC: Adding query filter params (role.id=3d8f099531114c74ad03cc59fe401ee9, scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1, user.id=d39fa904b4624167a95e95fad475d667) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:36.079145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65524068-e2b9-46a1-b547-89388fb31c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:36.080692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65524068-e2b9-46a1-b547-89388fb31c42 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:36.087589 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 159/318] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:35 2022] GET /identity/v3/role_assignments?user.id=d39fa904b4624167a95e95fad475d667&scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1&role.id=3d8f099531114c74ad03cc59fe401ee9 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:36.500400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63975a74-c55f-4027-81e8-444dab6dd2a7 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.501107 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63975a74-c55f-4027-81e8-444dab6dd2a7 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.501596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63975a74-c55f-4027-81e8-444dab6dd2a7 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.503376 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 160/319] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:36.509621 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19accf2-9295-4fd1-a8d0-b016467dfc2e None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.510233 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19accf2-9295-4fd1-a8d0-b016467dfc2e None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.510728 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19accf2-9295-4fd1-a8d0-b016467dfc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.534523 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-f19accf2-9295-4fd1-a8d0-b016467dfc2e None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:36.535749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-f19accf2-9295-4fd1-a8d0-b016467dfc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:36.646160 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 160/320] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:36.671637 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63975a74-c55f-4027-81e8-444dab6dd2a7 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:36.787078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63975a74-c55f-4027-81e8-444dab6dd2a7 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:36.831306 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec8d76-d36d-4158-81fa-1a04da81f286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:36.831937 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec8d76-d36d-4158-81fa-1a04da81f286 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.832216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec8d76-d36d-4158-81fa-1a04da81f286 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.832489 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec8d76-d36d-4158-81fa-1a04da81f286 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.833881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec8d76-d36d-4158-81fa-1a04da81f286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:36.835472 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec8d76-d36d-4158-81fa-1a04da81f286 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:36.845613 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 161/321] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:36.845888 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19accf2-9295-4fd1-a8d0-b016467dfc2e None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:36.929911 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:36.977942 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19accf2-9295-4fd1-a8d0-b016467dfc2e None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:36.979162 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c8097-a959-4d6c-ac37-6e5e43974b3d None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.979448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c8097-a959-4d6c-ac37-6e5e43974b3d None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.979721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c8097-a959-4d6c-ac37-6e5e43974b3d None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.981099 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 162/322] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:36.986633 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f4ee7-fa0c-4641-9273-de87aca8b337 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.986905 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f4ee7-fa0c-4641-9273-de87aca8b337 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.987188 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f4ee7-fa0c-4641-9273-de87aca8b337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.995004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:37.010681 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-9c8f4ee7-fa0c-4641-9273-de87aca8b337 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:37.011886 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-9c8f4ee7-fa0c-4641-9273-de87aca8b337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:37.023427 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c9d89-1afc-41a4-a137-c333caad1239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:37.024072 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c9d89-1afc-41a4-a137-c333caad1239 None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:37.024349 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c9d89-1afc-41a4-a137-c333caad1239 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:37.024623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c9d89-1afc-41a4-a137-c333caad1239 None admin] PATH_INFO: `/v3/groups` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:37.025296 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c9d89-1afc-41a4-a137-c333caad1239 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:37.026797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c9d89-1afc-41a4-a137-c333caad1239 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:37.047123 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 161/323] 10.222.0.60 () {60 vars in 1134 bytes} [Tue Jul 26 10:13:36 2022] POST /identity/v3/groups => generated 226 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:37.109296 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 163/324] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:37.133510 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c9d89-1afc-41a4-a137-c333caad1239 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:37.259625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c9d89-1afc-41a4-a137-c333caad1239 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:37.279816 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:37.286244 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbb849-0730-4152-b926-8640742ad5df None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:37.286648 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbb849-0730-4152-b926-8640742ad5df None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:37.286918 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbb849-0730-4152-b926-8640742ad5df None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:37.288379 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 164/325] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:37.295441 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915074c-1583-472b-81c2-3ab9d8f81638 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:37.295767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915074c-1583-472b-81c2-3ab9d8f81638 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:37.295986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915074c-1583-472b-81c2-3ab9d8f81638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:37.311408 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3e025-245a-482f-8859-6bd7cd76d482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:37.312022 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3e025-245a-482f-8859-6bd7cd76d482 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:37.312392 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3e025-245a-482f-8859-6bd7cd76d482 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:37.312681 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3e025-245a-482f-8859-6bd7cd76d482 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:37.319618 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-9915074c-1583-472b-81c2-3ab9d8f81638 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:37.320854 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-9915074c-1583-472b-81c2-3ab9d8f81638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:37.328554 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3e025-245a-482f-8859-6bd7cd76d482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-2dc3e025-245a-482f-8859-6bd7cd76d482 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:37.336401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:37.337544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:37.339377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:37.339377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:37.339377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:37.339377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:37.339377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:37.339377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:37.339377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:37.339377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:37.339377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:37.339377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:37.339377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:37.339377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:37.340052 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 162/326] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:37.345486 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3e025-245a-482f-8859-6bd7cd76d482 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:37.421690 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 165/327] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:37.462919 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915074c-1583-472b-81c2-3ab9d8f81638 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:37.495897 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3e025-245a-482f-8859-6bd7cd76d482 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:37.548478 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e2aaf-d862-4938-91f5-6f4af6785a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:37.549588 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e2aaf-d862-4938-91f5-6f4af6785a21 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:37.550075 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e2aaf-d862-4938-91f5-6f4af6785a21 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:37.550655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e2aaf-d862-4938-91f5-6f4af6785a21 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:37.552044 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e2aaf-d862-4938-91f5-6f4af6785a21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:37.552591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e2aaf-d862-4938-91f5-6f4af6785a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:37.556911 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e2aaf-d862-4938-91f5-6f4af6785a21 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:37.558362 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:37.577228 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 163/328] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:37.586026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e2aaf-d862-4938-91f5-6f4af6785a21 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:37.611854 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915074c-1583-472b-81c2-3ab9d8f81638 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:37.643559 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:37.682865 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983d0af-86c4-400f-a742-664c9124cc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:37.683942 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983d0af-86c4-400f-a742-664c9124cc71 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:37.684421 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983d0af-86c4-400f-a742-664c9124cc71 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:37.684893 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983d0af-86c4-400f-a742-664c9124cc71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:37.700329 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983d0af-86c4-400f-a742-664c9124cc71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-8983d0af-86c4-400f-a742-664c9124cc71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:37.706060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:37.706992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:37.707801 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:37.707801 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:37.707801 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:37.707801 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:37.707801 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:37.707801 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:37.707801 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:37.707801 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:37.707801 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:37.707801 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:37.707801 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:37.707801 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:37.710659 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 166/329] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:37.722406 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983d0af-86c4-400f-a742-664c9124cc71 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:37.770301 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e2aaf-d862-4938-91f5-6f4af6785a21 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:37.825408 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111da1b-49f3-4445-ad8b-65fd2b9de711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:37.826643 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111da1b-49f3-4445-ad8b-65fd2b9de711 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:37.827148 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111da1b-49f3-4445-ad8b-65fd2b9de711 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:37.827764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111da1b-49f3-4445-ad8b-65fd2b9de711 None admin] PATH_INFO: `/v3/users/72b3c3b0cae54e92952b920f5d1c773e` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:37.829340 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111da1b-49f3-4445-ad8b-65fd2b9de711 None admin] RBAC: Authorizing `identity:get_user(user_id=72b3c3b0cae54e92952b920f5d1c773e)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:37.831282 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111da1b-49f3-4445-ad8b-65fd2b9de711 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:37.833604 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 164/330] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:37 2022] GET /identity/v3/users/72b3c3b0cae54e92952b920f5d1c773e => generated 293 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:37.856386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111da1b-49f3-4445-ad8b-65fd2b9de711 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:37.882466 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983d0af-86c4-400f-a742-664c9124cc71 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:37.916692 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:37.940033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fff20-e6a7-42a3-a74b-37f7bff4ddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:37.940889 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fff20-e6a7-42a3-a74b-37f7bff4ddae None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:37.941206 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fff20-e6a7-42a3-a74b-37f7bff4ddae None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:37.941641 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fff20-e6a7-42a3-a74b-37f7bff4ddae None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:37.942568 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fff20-e6a7-42a3-a74b-37f7bff4ddae None admin] RBAC: Adding query filter params (name=member) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:37.942916 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fff20-e6a7-42a3-a74b-37f7bff4ddae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:37.945268 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fff20-e6a7-42a3-a74b-37f7bff4ddae None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:37.957067 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 167/331] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:37.965458 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fff20-e6a7-42a3-a74b-37f7bff4ddae None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:38.027329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111da1b-49f3-4445-ad8b-65fd2b9de711 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:38.030619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:38.070349 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce0ad7-64c6-44db-8604-97acc28724e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:38.071086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce0ad7-64c6-44db-8604-97acc28724e5 None admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:38.071360 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce0ad7-64c6-44db-8604-97acc28724e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:38.071807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce0ad7-64c6-44db-8604-97acc28724e5 None admin] PATH_INFO: `/v3/system/users/72b3c3b0cae54e92952b920f5d1c773e/roles/3d8f099531114c74ad03cc59fe401ee9` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:38.073688 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce0ad7-64c6-44db-8604-97acc28724e5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=72b3c3b0cae54e92952b920f5d1c773e, role_id=3d8f099531114c74ad03cc59fe401ee9)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:38.075193 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce0ad7-64c6-44db-8604-97acc28724e5 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:38.087012 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 165/332] 10.222.0.60 () {58 vars in 1334 bytes} [Tue Jul 26 10:13:37 2022] PUT /identity/v3/system/users/72b3c3b0cae54e92952b920f5d1c773e/roles/3d8f099531114c74ad03cc59fe401ee9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:38.168758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fff20-e6a7-42a3-a74b-37f7bff4ddae None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:38.218949 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c09b2-b096-492d-b672-ba8e438a8fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:38.219622 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c09b2-b096-492d-b672-ba8e438a8fe2 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:38.219898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c09b2-b096-492d-b672-ba8e438a8fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:38.220169 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c09b2-b096-492d-b672-ba8e438a8fe2 None admin] PATH_INFO: `/v3/users/b0f40b9e80ca4c2d93ac2ba52069c9ac` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:38.221393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c09b2-b096-492d-b672-ba8e438a8fe2 None admin] RBAC: Authorizing `identity:get_user(user_id=b0f40b9e80ca4c2d93ac2ba52069c9ac)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:38.222928 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c09b2-b096-492d-b672-ba8e438a8fe2 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:38.224872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 168/333] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:37 2022] GET /identity/v3/users/b0f40b9e80ca4c2d93ac2ba52069c9ac => generated 293 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:38.231125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce0ad7-64c6-44db-8604-97acc28724e5 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:38.364697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce0ad7-64c6-44db-8604-97acc28724e5 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:38.417546 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126b29e-f40f-4294-967c-f51a474016d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:38.418614 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126b29e-f40f-4294-967c-f51a474016d4 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:38.419096 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126b29e-f40f-4294-967c-f51a474016d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:38.419556 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126b29e-f40f-4294-967c-f51a474016d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:38.420681 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126b29e-f40f-4294-967c-f51a474016d4 None admin] RBAC: Adding query filter params (role.id=c483c855d04b4145a203e1f0eedf3c0c, user.id=b0f40b9e80ca4c2d93ac2ba52069c9ac, scope.system=all) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:38.421186 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126b29e-f40f-4294-967c-f51a474016d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:38.423031 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126b29e-f40f-4294-967c-f51a474016d4 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:38.443540 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 166/334] 10.222.0.60 () {56 vars in 1308 bytes} [Tue Jul 26 10:13:38 2022] GET /identity/v3/role_assignments?user.id=b0f40b9e80ca4c2d93ac2ba52069c9ac&scope.system=all&role.id=c483c855d04b4145a203e1f0eedf3c0c => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:40.381374 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d4dfe-d0da-43e9-aa24-ad81e9afcde6 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:40.381374 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d4dfe-d0da-43e9-aa24-ad81e9afcde6 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:40.381374 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d4dfe-d0da-43e9-aa24-ad81e9afcde6 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:40.381374 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 169/335] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:40.389234 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1805034-a876-417d-957a-d3195b9ad679 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:40.390233 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1805034-a876-417d-957a-d3195b9ad679 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:40.390714 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1805034-a876-417d-957a-d3195b9ad679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:40.410707 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-b1805034-a876-417d-957a-d3195b9ad679 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:40.412249 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-b1805034-a876-417d-957a-d3195b9ad679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:40.437052 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:40.491550 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 167/336] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:40.517936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d4dfe-d0da-43e9-aa24-ad81e9afcde6 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:40.584878 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:40.647840 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d4dfe-d0da-43e9-aa24-ad81e9afcde6 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:40.686468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea9933-d621-4bc6-8b86-bb615b55c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:40.687151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea9933-d621-4bc6-8b86-bb615b55c2fd None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:40.687425 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea9933-d621-4bc6-8b86-bb615b55c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:40.687693 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea9933-d621-4bc6-8b86-bb615b55c2fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:40.698850 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea9933-d621-4bc6-8b86-bb615b55c2fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-0cea9933-d621-4bc6-8b86-bb615b55c2fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:40.707355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:40.708778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:40.710108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:40.710108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:40.710108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:40.710108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:40.710108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:40.710108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:40.710108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:40.710108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:40.710108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:40.710108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:40.710108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:40.710108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:40.710108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 170/337] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:40.720387 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1805034-a876-417d-957a-d3195b9ad679 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:40.825789 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea03ee1-0d9c-4c16-a102-95c17117259d None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:40.826549 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea03ee1-0d9c-4c16-a102-95c17117259d None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:40.827027 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea03ee1-0d9c-4c16-a102-95c17117259d None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:40.828584 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 171/338] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:40.834890 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fb2e7-a796-45ff-a144-f7a47089c9f8 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:40.835518 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fb2e7-a796-45ff-a144-f7a47089c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:40.835995 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fb2e7-a796-45ff-a144-f7a47089c9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:40.865236 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-ae2fb2e7-a796-45ff-a144-f7a47089c9f8 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:40.866881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-ae2fb2e7-a796-45ff-a144-f7a47089c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:40.932863 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1805034-a876-417d-957a-d3195b9ad679 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:40.959373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 172/339] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:41.010079 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fb2e7-a796-45ff-a144-f7a47089c9f8 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:41.030012 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0338d-65b9-46fb-bcb1-709f5199208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:41.031033 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0338d-65b9-46fb-bcb1-709f5199208e None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:41.031483 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0338d-65b9-46fb-bcb1-709f5199208e None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:41.031902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0338d-65b9-46fb-bcb1-709f5199208e None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:41.032782 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0338d-65b9-46fb-bcb1-709f5199208e None admin] RBAC: Adding query filter params (name=member) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:41.035073 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0338d-65b9-46fb-bcb1-709f5199208e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:41.036670 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0338d-65b9-46fb-bcb1-709f5199208e None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:41.062603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 168/340] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:41.069898 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0338d-65b9-46fb-bcb1-709f5199208e None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:41.106869 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:41.124301 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:41.193534 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fb2e7-a796-45ff-a144-f7a47089c9f8 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:41.251521 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a700ed6-0dfe-4ff6-81a1-941de2af97ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:41.252203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a700ed6-0dfe-4ff6-81a1-941de2af97ae None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:41.252479 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a700ed6-0dfe-4ff6-81a1-941de2af97ae None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:41.252756 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a700ed6-0dfe-4ff6-81a1-941de2af97ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:41.269975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a700ed6-0dfe-4ff6-81a1-941de2af97ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-0a700ed6-0dfe-4ff6-81a1-941de2af97ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:41.279267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:41.280953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:41.282562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:41.282562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:41.282562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:41.282562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:41.282562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:41.282562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:41.282562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:41.282562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:41.282562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:41.282562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:41.282562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:41.282562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:41.282562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 173/341] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:41.291473 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a700ed6-0dfe-4ff6-81a1-941de2af97ae None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:41.373996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0338d-65b9-46fb-bcb1-709f5199208e None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:41.443882 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a700ed6-0dfe-4ff6-81a1-941de2af97ae None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:41.447419 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:41.516221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854da12-c12a-4321-bd64-cbc1ea001f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:41.516883 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854da12-c12a-4321-bd64-cbc1ea001f47 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:41.517162 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854da12-c12a-4321-bd64-cbc1ea001f47 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:41.517431 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854da12-c12a-4321-bd64-cbc1ea001f47 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:41.518178 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854da12-c12a-4321-bd64-cbc1ea001f47 None admin] RBAC: Adding query filter params (name=member) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:41.518650 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854da12-c12a-4321-bd64-cbc1ea001f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:41.520055 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854da12-c12a-4321-bd64-cbc1ea001f47 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:41.520948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ce4c7-b14c-4116-b11f-c19895fe758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:41.522166 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ce4c7-b14c-4116-b11f-c19895fe758e None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:41.522712 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ce4c7-b14c-4116-b11f-c19895fe758e None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:41.523064 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ce4c7-b14c-4116-b11f-c19895fe758e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:41.540965 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 174/342] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:41.546967 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854da12-c12a-4321-bd64-cbc1ea001f47 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:41.671433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ce4c7-b14c-4116-b11f-c19895fe758e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:41.672949 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ce4c7-b14c-4116-b11f-c19895fe758e None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:41.707938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:41.738314 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854da12-c12a-4321-bd64-cbc1ea001f47 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:41.807332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd99623-f4e2-4e0a-b182-d8686ff470ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:41.807892 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd99623-f4e2-4e0a-b182-d8686ff470ad None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:41.808175 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd99623-f4e2-4e0a-b182-d8686ff470ad None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:41.808452 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd99623-f4e2-4e0a-b182-d8686ff470ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:41.845368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 169/343] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 776 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:41.851436 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60baf1-4002-48f9-85c6-07e4ef35c889 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:41.852064 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60baf1-4002-48f9-85c6-07e4ef35c889 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:41.852554 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60baf1-4002-48f9-85c6-07e4ef35c889 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:41.854284 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 170/344] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:41.856313 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60baf1-4002-48f9-85c6-07e4ef35c889 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:41.867153 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:41.918108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd99623-f4e2-4e0a-b182-d8686ff470ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:41.919802 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd99623-f4e2-4e0a-b182-d8686ff470ad None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:41.974088 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60baf1-4002-48f9-85c6-07e4ef35c889 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:42.008197 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:42.027357 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8cd65-2f93-4ed7-8264-bec0fcaa1712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:42.028406 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8cd65-2f93-4ed7-8264-bec0fcaa1712 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.029493 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8cd65-2f93-4ed7-8264-bec0fcaa1712 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.029990 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8cd65-2f93-4ed7-8264-bec0fcaa1712 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.035134 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8cd65-2f93-4ed7-8264-bec0fcaa1712 None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:42.036630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8cd65-2f93-4ed7-8264-bec0fcaa1712 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:42.041258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 171/345] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:41 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:42.042855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6e789-4899-4595-ab4c-348161f71aec None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.043369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6e789-4899-4595-ab4c-348161f71aec None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.043835 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6e789-4899-4595-ab4c-348161f71aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.073096 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-90b6e789-4899-4595-ab4c-348161f71aec None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:42.074577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-90b6e789-4899-4595-ab4c-348161f71aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:42.113800 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 175/346] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:13:42.115530 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845cc6e-bc1c-48e1-a47e-952d717e7d43 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.116033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845cc6e-bc1c-48e1-a47e-952d717e7d43 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.116513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845cc6e-bc1c-48e1-a47e-952d717e7d43 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.119405 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 176/347] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:42.120517 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845cc6e-bc1c-48e1-a47e-952d717e7d43 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.154867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 172/348] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:42.156069 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6e789-4899-4595-ab4c-348161f71aec None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.194108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:42.245270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845cc6e-bc1c-48e1-a47e-952d717e7d43 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:42.288530 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6e789-4899-4595-ab4c-348161f71aec None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:42.302138 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565cb42-3306-4e3d-9712-81626a7b2a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:42.303106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565cb42-3306-4e3d-9712-81626a7b2a96 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.303525 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565cb42-3306-4e3d-9712-81626a7b2a96 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.303935 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565cb42-3306-4e3d-9712-81626a7b2a96 None admin] PATH_INFO: `/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.309701 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:42.311566 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565cb42-3306-4e3d-9712-81626a7b2a96 None admin] RBAC: Authorizing `identity:get_group(group_id=fb381ccab4c04e6480a7eeac0c3c169c)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:42.313275 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565cb42-3306-4e3d-9712-81626a7b2a96 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:42.315921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 177/349] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Jul 26 10:13:42 2022] GET /identity/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:42.319772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8b4fb-0b08-4aea-88c4-ec7d30fde58c None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.320056 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8b4fb-0b08-4aea-88c4-ec7d30fde58c None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.320327 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8b4fb-0b08-4aea-88c4-ec7d30fde58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.336251 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113c084-2a4c-4ea8-9c74-4cf30dac6a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:42.336753 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113c084-2a4c-4ea8-9c74-4cf30dac6a60 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.337197 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113c084-2a4c-4ea8-9c74-4cf30dac6a60 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.337475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113c084-2a4c-4ea8-9c74-4cf30dac6a60 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.338745 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113c084-2a4c-4ea8-9c74-4cf30dac6a60 None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:42.341639 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113c084-2a4c-4ea8-9c74-4cf30dac6a60 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:42.342183 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 173/350] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:42 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:42.346558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a88203-f35a-4dbf-a138-51caa305bf00 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.346684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-97d8b4fb-0b08-4aea-88c4-ec7d30fde58c None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:42.346762 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a88203-f35a-4dbf-a138-51caa305bf00 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.346762 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a88203-f35a-4dbf-a138-51caa305bf00 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.346975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-97d8b4fb-0b08-4aea-88c4-ec7d30fde58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:42.347044 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 174/351] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:42.347044 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a88203-f35a-4dbf-a138-51caa305bf00 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.440560 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 178/352] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:42.441779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8b4fb-0b08-4aea-88c4-ec7d30fde58c None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.475041 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a88203-f35a-4dbf-a138-51caa305bf00 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:42.510305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:42.515162 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca6960-bfca-4613-832f-365d49a90b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:42.515832 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca6960-bfca-4613-832f-365d49a90b6e None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.516113 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca6960-bfca-4613-832f-365d49a90b6e None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.516381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca6960-bfca-4613-832f-365d49a90b6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.530335 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca6960-bfca-4613-832f-365d49a90b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-c8ca6960-bfca-4613-832f-365d49a90b6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:42.536937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:42.538061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:42.539503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:42.539503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:42.539503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:42.539503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:42.539503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:42.539503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:42.539503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:42.539503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:42.539503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:42.539503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:42.539503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:42.539503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:42.539503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 175/353] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:42.539503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca6960-bfca-4613-832f-365d49a90b6e None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.563272 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8b4fb-0b08-4aea-88c4-ec7d30fde58c None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:42.595866 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:42.605300 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc3d20-6373-4432-89ce-51b7c9606dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:42.605920 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc3d20-6373-4432-89ce-51b7c9606dbf None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.606215 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc3d20-6373-4432-89ce-51b7c9606dbf None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.606620 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc3d20-6373-4432-89ce-51b7c9606dbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.607656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc3d20-6373-4432-89ce-51b7c9606dbf None admin] RBAC: Adding query filter params (group.id=fb381ccab4c04e6480a7eeac0c3c169c, role.id=c483c855d04b4145a203e1f0eedf3c0c, scope.project.id=da2d23ccca37438b90e87196aa0fbe36) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:42.607914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc3d20-6373-4432-89ce-51b7c9606dbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:42.609298 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc3d20-6373-4432-89ce-51b7c9606dbf None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:42.617541 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 179/354] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Jul 26 10:13:42 2022] GET /identity/v3/role_assignments?group.id=fb381ccab4c04e6480a7eeac0c3c169c&scope.project.id=da2d23ccca37438b90e87196aa0fbe36&role.id=c483c855d04b4145a203e1f0eedf3c0c => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:42.622459 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b418471-c3cd-49b6-b4dc-acc23406e0b8 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.622459 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b418471-c3cd-49b6-b4dc-acc23406e0b8 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.622459 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b418471-c3cd-49b6-b4dc-acc23406e0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.642077 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-1b418471-c3cd-49b6-b4dc-acc23406e0b8 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:42.643359 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-1b418471-c3cd-49b6-b4dc-acc23406e0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:42.682421 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca6960-bfca-4613-832f-365d49a90b6e None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:42.728247 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b3153-57ab-4978-bb72-fc0b520d1514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:42.728971 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b3153-57ab-4978-bb72-fc0b520d1514 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.729247 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b3153-57ab-4978-bb72-fc0b520d1514 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.729519 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b3153-57ab-4978-bb72-fc0b520d1514 None admin] PATH_INFO: `/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.731427 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b3153-57ab-4978-bb72-fc0b520d1514 None admin] RBAC: Authorizing `identity:get_group(group_id=fb381ccab4c04e6480a7eeac0c3c169c)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:42.732935 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b3153-57ab-4978-bb72-fc0b520d1514 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:42.735059 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 176/355] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Jul 26 10:13:42 2022] GET /identity/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:42.736837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c38be-6e2f-470f-ab6d-7de2cdb9911a None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.736837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c38be-6e2f-470f-ab6d-7de2cdb9911a None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.737064 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c38be-6e2f-470f-ab6d-7de2cdb9911a None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.738602 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 177/356] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:42.739432 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c38be-6e2f-470f-ab6d-7de2cdb9911a None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.746582 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 180/357] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:42.747903 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b418471-c3cd-49b6-b4dc-acc23406e0b8 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.830459 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:42.894340 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b418471-c3cd-49b6-b4dc-acc23406e0b8 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:42.909861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c38be-6e2f-470f-ab6d-7de2cdb9911a None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:42.928554 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:42.941784 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce8a43-be86-49ef-aa8d-bac91d9d223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:42.942423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce8a43-be86-49ef-aa8d-bac91d9d223c None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.942740 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce8a43-be86-49ef-aa8d-bac91d9d223c None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.943012 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce8a43-be86-49ef-aa8d-bac91d9d223c None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.943739 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce8a43-be86-49ef-aa8d-bac91d9d223c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:42.944255 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce8a43-be86-49ef-aa8d-bac91d9d223c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:42.946097 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce8a43-be86-49ef-aa8d-bac91d9d223c None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:42.955228 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 181/358] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:42.956088 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce8a43-be86-49ef-aa8d-bac91d9d223c None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.959111 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc346f82-189b-42e6-a8c0-5cb050ba3f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:42.960915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc346f82-189b-42e6-a8c0-5cb050ba3f93 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.962277 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc346f82-189b-42e6-a8c0-5cb050ba3f93 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.962697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc346f82-189b-42e6-a8c0-5cb050ba3f93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.980039 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc346f82-189b-42e6-a8c0-5cb050ba3f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-bc346f82-189b-42e6-a8c0-5cb050ba3f93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:42.986173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:42.987306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:42.988312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:42.988312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:42.988312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:42.988312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:42.988312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:42.988312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:42.988312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:42.988312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:42.988312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:42.988312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:42.988312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:42.988312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:42.988312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 178/359] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:42.988992 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70359732-c21d-4295-82f6-aeb67b2cf4dd None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.989143 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70359732-c21d-4295-82f6-aeb67b2cf4dd None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.989352 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70359732-c21d-4295-82f6-aeb67b2cf4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:43.013188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-70359732-c21d-4295-82f6-aeb67b2cf4dd None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:43.014081 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-70359732-c21d-4295-82f6-aeb67b2cf4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:43.090285 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce8a43-be86-49ef-aa8d-bac91d9d223c None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:43.111099 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:43.120464 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 179/360] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:43.121712 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70359732-c21d-4295-82f6-aeb67b2cf4dd None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:43.158526 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4708f-6228-4369-a987-7a861de24307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:43.159157 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4708f-6228-4369-a987-7a861de24307 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:43.159434 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4708f-6228-4369-a987-7a861de24307 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:43.160578 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4708f-6228-4369-a987-7a861de24307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:43.160578 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4708f-6228-4369-a987-7a861de24307 None admin] RBAC: Adding query filter params (group.id=fb381ccab4c04e6480a7eeac0c3c169c, role.id=c483c855d04b4145a203e1f0eedf3c0c, scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:43.160874 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4708f-6228-4369-a987-7a861de24307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:43.162323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4708f-6228-4369-a987-7a861de24307 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:43.168849 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 182/361] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Jul 26 10:13:42 2022] GET /identity/v3/role_assignments?group.id=fb381ccab4c04e6480a7eeac0c3c169c&scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1&role.id=c483c855d04b4145a203e1f0eedf3c0c => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:43.169824 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4708f-6228-4369-a987-7a861de24307 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:43.248769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70359732-c21d-4295-82f6-aeb67b2cf4dd None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:43.250823 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:43.301336 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4708f-6228-4369-a987-7a861de24307 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:43.306508 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2d99f-2af5-46c1-a923-65969fbb70e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:43.307699 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2d99f-2af5-46c1-a923-65969fbb70e8 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:43.308251 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2d99f-2af5-46c1-a923-65969fbb70e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:43.308799 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2d99f-2af5-46c1-a923-65969fbb70e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:43.330791 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2d99f-2af5-46c1-a923-65969fbb70e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:43.340432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc547d4-abe2-4cb2-84fa-71530700c092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:43.340967 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc547d4-abe2-4cb2-84fa-71530700c092 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:43.341250 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc547d4-abe2-4cb2-84fa-71530700c092 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:43.341612 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc547d4-abe2-4cb2-84fa-71530700c092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-0cd2d99f-2af5-46c1-a923-65969fbb70e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:43.342743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:43.344476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:43.346048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:43.346048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:43.346048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:43.346048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:43.346048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:43.346048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:43.346048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:43.346048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:43.346048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:43.346048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:43.346048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:13:43.346048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:43.346048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 180/362] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:43.354481 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2d99f-2af5-46c1-a923-65969fbb70e8 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:43.428958 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:43.460270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc547d4-abe2-4cb2-84fa-71530700c092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:43.462372 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc547d4-abe2-4cb2-84fa-71530700c092 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:43.510078 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2d99f-2af5-46c1-a923-65969fbb70e8 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:43.556975 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7116bd-6f7e-4bd8-8cd5-7f96b354061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:43.557982 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7116bd-6f7e-4bd8-8cd5-7f96b354061c None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:43.558454 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7116bd-6f7e-4bd8-8cd5-7f96b354061c None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:43.558964 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7116bd-6f7e-4bd8-8cd5-7f96b354061c None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:43.560333 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7116bd-6f7e-4bd8-8cd5-7f96b354061c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:43.561065 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7116bd-6f7e-4bd8-8cd5-7f96b354061c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:43.563704 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7116bd-6f7e-4bd8-8cd5-7f96b354061c None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:43.583303 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 181/363] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:43.589597 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7116bd-6f7e-4bd8-8cd5-7f96b354061c None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:43.612348 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 183/364] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:43.617964 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc547d4-abe2-4cb2-84fa-71530700c092 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:43.653896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:43.778523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:43.790859 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7116bd-6f7e-4bd8-8cd5-7f96b354061c None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:43.816684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc547d4-abe2-4cb2-84fa-71530700c092 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:43.861918 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa693109-f55d-4311-8dd0-d3ded71d2428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:43.863188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa693109-f55d-4311-8dd0-d3ded71d2428 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:43.864982 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa693109-f55d-4311-8dd0-d3ded71d2428 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:43.865530 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa693109-f55d-4311-8dd0-d3ded71d2428 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:43.882922 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69e815-469d-4c0a-85e7-1f1fca0827dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:43.883555 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69e815-469d-4c0a-85e7-1f1fca0827dd None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:43.883833 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69e815-469d-4c0a-85e7-1f1fca0827dd None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:43.884104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69e815-469d-4c0a-85e7-1f1fca0827dd None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:43.884836 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69e815-469d-4c0a-85e7-1f1fca0827dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:43.885138 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69e815-469d-4c0a-85e7-1f1fca0827dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:43.886776 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa693109-f55d-4311-8dd0-d3ded71d2428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:43.887004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69e815-469d-4c0a-85e7-1f1fca0827dd None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:43.896613 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 184/365] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-fa693109-f55d-4311-8dd0-d3ded71d2428 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:43.897336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:43.899414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:43.901337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:43.901337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:43.901337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:43.901337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:43.901337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:43.901337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:43.901337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:43.901337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:43.901337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:43.901337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:43.901337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:43.901337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:43.902875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69e815-469d-4c0a-85e7-1f1fca0827dd None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:43.906550 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 182/366] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:43.906550 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa693109-f55d-4311-8dd0-d3ded71d2428 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:44.030830 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:44.040157 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69e815-469d-4c0a-85e7-1f1fca0827dd None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:44.043087 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa693109-f55d-4311-8dd0-d3ded71d2428 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:44.084711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fd4b0-9bfe-4432-ae70-4f6f7a8e49af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:44.085596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fd4b0-9bfe-4432-ae70-4f6f7a8e49af None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:44.086013 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fd4b0-9bfe-4432-ae70-4f6f7a8e49af None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:44.086467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fd4b0-9bfe-4432-ae70-4f6f7a8e49af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:44.092603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed5856-adbd-4955-8d77-179b08cc4b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:44.093413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed5856-adbd-4955-8d77-179b08cc4b2b None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:44.093690 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed5856-adbd-4955-8d77-179b08cc4b2b None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:44.093959 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed5856-adbd-4955-8d77-179b08cc4b2b None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:44.095244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed5856-adbd-4955-8d77-179b08cc4b2b None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:44.096655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed5856-adbd-4955-8d77-179b08cc4b2b None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:44.099199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 183/367] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:43 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:44.099997 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed5856-adbd-4955-8d77-179b08cc4b2b None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:44.102654 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:44.163146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fd4b0-9bfe-4432-ae70-4f6f7a8e49af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:44.165453 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fd4b0-9bfe-4432-ae70-4f6f7a8e49af None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:44.210678 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed5856-adbd-4955-8d77-179b08cc4b2b None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:44.248548 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085059eb-a611-4bfc-9dfe-36c3af20a811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:44.249205 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085059eb-a611-4bfc-9dfe-36c3af20a811 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:44.249477 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085059eb-a611-4bfc-9dfe-36c3af20a811 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:44.249823 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085059eb-a611-4bfc-9dfe-36c3af20a811 None admin] PATH_INFO: `/v3/users/72b3c3b0cae54e92952b920f5d1c773e` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:44.250999 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085059eb-a611-4bfc-9dfe-36c3af20a811 None admin] RBAC: Authorizing `identity:get_user(user_id=72b3c3b0cae54e92952b920f5d1c773e)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:44.252586 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085059eb-a611-4bfc-9dfe-36c3af20a811 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:44.260316 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 184/368] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:44 2022] GET /identity/v3/users/72b3c3b0cae54e92952b920f5d1c773e => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:44.261371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085059eb-a611-4bfc-9dfe-36c3af20a811 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:44.273689 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 185/369] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:44.274941 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fd4b0-9bfe-4432-ae70-4f6f7a8e49af None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:44.286475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:44.321972 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:44.376270 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085059eb-a611-4bfc-9dfe-36c3af20a811 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:44.385038 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fd4b0-9bfe-4432-ae70-4f6f7a8e49af None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:44.413393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179545f-c5d0-443c-b483-e668ecc16d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:44.414306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179545f-c5d0-443c-b483-e668ecc16d7f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:44.414613 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179545f-c5d0-443c-b483-e668ecc16d7f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:44.414884 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179545f-c5d0-443c-b483-e668ecc16d7f None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:44.415716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179545f-c5d0-443c-b483-e668ecc16d7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:44.416015 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179545f-c5d0-443c-b483-e668ecc16d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:44.417581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179545f-c5d0-443c-b483-e668ecc16d7f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:44.424993 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab883ba1-76cc-4093-b138-1541b1ed776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:44.426002 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883ba1-76cc-4093-b138-1541b1ed776b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:44.426546 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883ba1-76cc-4093-b138-1541b1ed776b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:44.427010 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883ba1-76cc-4093-b138-1541b1ed776b None admin] PATH_INFO: `/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:44.427530 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 185/370] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:44.429093 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179545f-c5d0-443c-b483-e668ecc16d7f None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:44.429928 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab883ba1-76cc-4093-b138-1541b1ed776b None admin] RBAC: Authorizing `identity:get_group(group_id=fb381ccab4c04e6480a7eeac0c3c169c)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:44.431659 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab883ba1-76cc-4093-b138-1541b1ed776b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:44.434014 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 186/371] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Jul 26 10:13:44 2022] GET /identity/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:44.435086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab883ba1-76cc-4093-b138-1541b1ed776b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:44.521927 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:44.543863 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179545f-c5d0-443c-b483-e668ecc16d7f None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:44.546593 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab883ba1-76cc-4093-b138-1541b1ed776b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:44.559945 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:44.584872 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851e639-93b6-448f-91b2-cfa01ee83606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:44.585555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851e639-93b6-448f-91b2-cfa01ee83606 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:44.585871 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851e639-93b6-448f-91b2-cfa01ee83606 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:44.586141 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851e639-93b6-448f-91b2-cfa01ee83606 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:44.587106 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851e639-93b6-448f-91b2-cfa01ee83606 None admin] RBAC: Adding query filter params (role.id=3d8f099531114c74ad03cc59fe401ee9, user.id=72b3c3b0cae54e92952b920f5d1c773e, scope.system=all) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:44.587412 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851e639-93b6-448f-91b2-cfa01ee83606 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:44.588997 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851e639-93b6-448f-91b2-cfa01ee83606 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:44.589329 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294a9f7-6a3a-460c-a2b7-89ccfa3e769e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:44.590218 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294a9f7-6a3a-460c-a2b7-89ccfa3e769e None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:44.590861 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294a9f7-6a3a-460c-a2b7-89ccfa3e769e None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:44.591389 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294a9f7-6a3a-460c-a2b7-89ccfa3e769e None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:44.592989 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294a9f7-6a3a-460c-a2b7-89ccfa3e769e None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:44.594723 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294a9f7-6a3a-460c-a2b7-89ccfa3e769e None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:44.596933 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 187/372] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:44 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:44.597980 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294a9f7-6a3a-460c-a2b7-89ccfa3e769e None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:44.604575 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 186/373] 10.222.0.60 () {56 vars in 1308 bytes} [Tue Jul 26 10:13:44 2022] GET /identity/v3/role_assignments?user.id=72b3c3b0cae54e92952b920f5d1c773e&scope.system=all&role.id=3d8f099531114c74ad03cc59fe401ee9 => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:44.605357 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851e639-93b6-448f-91b2-cfa01ee83606 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:44.711514 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294a9f7-6a3a-460c-a2b7-89ccfa3e769e None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:44.754956 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab538be3-5169-4fac-b7bf-60619d8ed686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:44.755995 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab538be3-5169-4fac-b7bf-60619d8ed686 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:44.756469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab538be3-5169-4fac-b7bf-60619d8ed686 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:44.756928 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab538be3-5169-4fac-b7bf-60619d8ed686 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:44.761927 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851e639-93b6-448f-91b2-cfa01ee83606 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:44.808562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:44.817947 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90afa4-e141-44fe-be04-f811e55786a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:44.818608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90afa4-e141-44fe-be04-f811e55786a0 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:44.818880 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90afa4-e141-44fe-be04-f811e55786a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:44.819147 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90afa4-e141-44fe-be04-f811e55786a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:44.819942 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90afa4-e141-44fe-be04-f811e55786a0 None admin] RBAC: Adding query filter params (group.id=fb381ccab4c04e6480a7eeac0c3c169c, role.id=2ae24c72c8264d0ba34cbe573083cc33, scope.project.id=da2d23ccca37438b90e87196aa0fbe36) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:44.820244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90afa4-e141-44fe-be04-f811e55786a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:44.821713 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90afa4-e141-44fe-be04-f811e55786a0 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:44.832629 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 187/374] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Jul 26 10:13:44 2022] GET /identity/v3/role_assignments?group.id=fb381ccab4c04e6480a7eeac0c3c169c&scope.project.id=da2d23ccca37438b90e87196aa0fbe36&role.id=2ae24c72c8264d0ba34cbe573083cc33 => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:44.833517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90afa4-e141-44fe-be04-f811e55786a0 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:44.835198 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab538be3-5169-4fac-b7bf-60619d8ed686 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:44.836992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab538be3-5169-4fac-b7bf-60619d8ed686 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:44.844407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:44.955008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 188/375] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:44.960897 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab538be3-5169-4fac-b7bf-60619d8ed686 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:44.992524 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90afa4-e141-44fe-be04-f811e55786a0 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:45.052799 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbacca6-3cf2-423a-93b7-2a7526da71cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:45.053472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbacca6-3cf2-423a-93b7-2a7526da71cb None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.053746 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbacca6-3cf2-423a-93b7-2a7526da71cb None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.054013 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbacca6-3cf2-423a-93b7-2a7526da71cb None admin] PATH_INFO: `/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.055481 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbacca6-3cf2-423a-93b7-2a7526da71cb None admin] RBAC: Authorizing `identity:get_group(group_id=fb381ccab4c04e6480a7eeac0c3c169c)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:45.056901 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbacca6-3cf2-423a-93b7-2a7526da71cb None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:45.058726 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 188/376] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Jul 26 10:13:44 2022] GET /identity/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:45.065705 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbacca6-3cf2-423a-93b7-2a7526da71cb None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:45.082708 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:45.116284 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab538be3-5169-4fac-b7bf-60619d8ed686 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:45.167663 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d765948-387d-45a5-be93-974c8455b5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:45.168247 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:45.168929 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d765948-387d-45a5-be93-974c8455b5e2 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.169584 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d765948-387d-45a5-be93-974c8455b5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.170076 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d765948-387d-45a5-be93-974c8455b5e2 None admin] PATH_INFO: `/v3/projects/a699385ce385472fabea3d65e4ca80c6` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.172022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d765948-387d-45a5-be93-974c8455b5e2 None admin] RBAC: Authorizing `identity:get_project(project_id=a699385ce385472fabea3d65e4ca80c6)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:45.173817 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d765948-387d-45a5-be93-974c8455b5e2 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:45.176366 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 189/377] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:44 2022] GET /identity/v3/projects/a699385ce385472fabea3d65e4ca80c6 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:45.181950 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d765948-387d-45a5-be93-974c8455b5e2 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:45.211591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbacca6-3cf2-423a-93b7-2a7526da71cb None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:45.256833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bb6a8-72da-415a-9af9-3dd879082238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:45.257390 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb6a8-72da-415a-9af9-3dd879082238 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.257670 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb6a8-72da-415a-9af9-3dd879082238 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.257948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb6a8-72da-415a-9af9-3dd879082238 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.259312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bb6a8-72da-415a-9af9-3dd879082238 None admin] RBAC: Adding query filter params (group.id=fb381ccab4c04e6480a7eeac0c3c169c, role.id=2ae24c72c8264d0ba34cbe573083cc33, scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:45.259624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bb6a8-72da-415a-9af9-3dd879082238 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:45.261468 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bb6a8-72da-415a-9af9-3dd879082238 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:45.273480 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 189/378] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Jul 26 10:13:45 2022] GET /identity/v3/role_assignments?group.id=fb381ccab4c04e6480a7eeac0c3c169c&scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1&role.id=2ae24c72c8264d0ba34cbe573083cc33 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:45.342934 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d765948-387d-45a5-be93-974c8455b5e2 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:45.385919 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288c7f3-be40-4100-97b9-c45188630ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:45.386634 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288c7f3-be40-4100-97b9-c45188630ad4 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.386914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288c7f3-be40-4100-97b9-c45188630ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.387186 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288c7f3-be40-4100-97b9-c45188630ad4 None admin] PATH_INFO: `/v3/groups/0405d31a084842cca2b746fe0c7ec214` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.393700 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288c7f3-be40-4100-97b9-c45188630ad4 None admin] RBAC: Authorizing `identity:get_group(group_id=0405d31a084842cca2b746fe0c7ec214)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:45.395252 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288c7f3-be40-4100-97b9-c45188630ad4 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:45.397324 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 190/379] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Jul 26 10:13:45 2022] GET /identity/v3/groups/0405d31a084842cca2b746fe0c7ec214 => generated 229 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:45.403768 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bb6a8-72da-415a-9af9-3dd879082238 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:45.527052 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bb6a8-72da-415a-9af9-3dd879082238 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:45.555579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db769389-a59a-41b1-8b2c-2b9331129400 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.555892 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db769389-a59a-41b1-8b2c-2b9331129400 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.556124 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db769389-a59a-41b1-8b2c-2b9331129400 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.557647 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 191/380] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:45.563332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39de68-a99c-4309-a0f2-a6266224e39e None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.563610 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39de68-a99c-4309-a0f2-a6266224e39e None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.563886 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39de68-a99c-4309-a0f2-a6266224e39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.568054 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619c5fd-f8dd-44a3-ae63-30a1bc568efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:45.568681 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619c5fd-f8dd-44a3-ae63-30a1bc568efa None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.568960 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619c5fd-f8dd-44a3-ae63-30a1bc568efa None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.569235 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619c5fd-f8dd-44a3-ae63-30a1bc568efa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.570032 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619c5fd-f8dd-44a3-ae63-30a1bc568efa None admin] RBAC: Adding query filter params (group.id=0405d31a084842cca2b746fe0c7ec214, role.id=7d88b748366a42929784db05d53fe473, scope.project.id=a699385ce385472fabea3d65e4ca80c6) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:45.570341 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619c5fd-f8dd-44a3-ae63-30a1bc568efa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:45.571828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619c5fd-f8dd-44a3-ae63-30a1bc568efa None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:45.576378 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:45.580083 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 190/381] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Jul 26 10:13:45 2022] GET /identity/v3/role_assignments?group.id=0405d31a084842cca2b746fe0c7ec214&scope.project.id=a699385ce385472fabea3d65e4ca80c6&role.id=7d88b748366a42929784db05d53fe473 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:45.599870 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-8e39de68-a99c-4309-a0f2-a6266224e39e None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:45.601158 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-8e39de68-a99c-4309-a0f2-a6266224e39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:45.605920 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:45.717258 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 192/382] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:45.753300 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619c5fd-f8dd-44a3-ae63-30a1bc568efa None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:45.893465 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619c5fd-f8dd-44a3-ae63-30a1bc568efa None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:45.943259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5a594-bd90-49e0-af11-eb0a4daf8352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:45.944370 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5a594-bd90-49e0-af11-eb0a4daf8352 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.944852 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5a594-bd90-49e0-af11-eb0a4daf8352 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.945327 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5a594-bd90-49e0-af11-eb0a4daf8352 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.961662 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5a594-bd90-49e0-af11-eb0a4daf8352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-d2f5a594-bd90-49e0-af11-eb0a4daf8352 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:45.967558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:45.968475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:45.969269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:45.969269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:45.969269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:45.969269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:45.969269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:45.969269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:45.969269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:45.969269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:45.969269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:45.969269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:45.969269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:45.969269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:45.971939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 191/383] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:45.977635 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39de68-a99c-4309-a0f2-a6266224e39e None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:46.101657 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39de68-a99c-4309-a0f2-a6266224e39e None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:46.129605 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57318e-52ed-46d1-a29e-cbb7726eed71 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:46.129887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57318e-52ed-46d1-a29e-cbb7726eed71 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:46.130318 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57318e-52ed-46d1-a29e-cbb7726eed71 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:46.135558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 192/384] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:46.136991 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145de1ed-c0a1-4243-9029-4a9b72e2c610 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:46.137475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145de1ed-c0a1-4243-9029-4a9b72e2c610 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:46.137981 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145de1ed-c0a1-4243-9029-4a9b72e2c610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:46.139236 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae13874-202a-42e9-8304-69964936f256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:46.139874 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae13874-202a-42e9-8304-69964936f256 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:46.140153 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae13874-202a-42e9-8304-69964936f256 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:46.140428 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae13874-202a-42e9-8304-69964936f256 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:46.141164 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae13874-202a-42e9-8304-69964936f256 None admin] RBAC: Adding query filter params (name=member) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:46.141468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae13874-202a-42e9-8304-69964936f256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:46.146522 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae13874-202a-42e9-8304-69964936f256 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:46.153091 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 193/385] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:46.159051 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae13874-202a-42e9-8304-69964936f256 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:46.162147 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:46.179526 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-145de1ed-c0a1-4243-9029-4a9b72e2c610 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:46.181129 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-145de1ed-c0a1-4243-9029-4a9b72e2c610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:46.270023 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae13874-202a-42e9-8304-69964936f256 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:46.271604 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:46.287495 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 193/386] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:46.312393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44708a5a-39ae-4df1-ba8d-725e69f26f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:46.313468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44708a5a-39ae-4df1-ba8d-725e69f26f5e None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:46.313946 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44708a5a-39ae-4df1-ba8d-725e69f26f5e None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:46.314414 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44708a5a-39ae-4df1-ba8d-725e69f26f5e None admin] PATH_INFO: `/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:46.315884 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44708a5a-39ae-4df1-ba8d-725e69f26f5e None admin] RBAC: Authorizing `identity:get_group(group_id=fb381ccab4c04e6480a7eeac0c3c169c)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:46.317586 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44708a5a-39ae-4df1-ba8d-725e69f26f5e None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:46.319826 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 194/387] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Jul 26 10:13:46 2022] GET /identity/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:46.326920 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145de1ed-c0a1-4243-9029-4a9b72e2c610 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:46.363121 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44708a5a-39ae-4df1-ba8d-725e69f26f5e None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:46.491413 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:46.508111 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145de1ed-c0a1-4243-9029-4a9b72e2c610 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:46.549764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05099e72-ebed-4158-8b43-9d9a508fa2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:46.550454 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05099e72-ebed-4158-8b43-9d9a508fa2cd None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:46.550735 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05099e72-ebed-4158-8b43-9d9a508fa2cd None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:46.551016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05099e72-ebed-4158-8b43-9d9a508fa2cd None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:46.553002 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05099e72-ebed-4158-8b43-9d9a508fa2cd None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:46.554509 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05099e72-ebed-4158-8b43-9d9a508fa2cd None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:46.556232 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 194/388] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:46 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:46.566632 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44708a5a-39ae-4df1-ba8d-725e69f26f5e None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:46.568550 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05099e72-ebed-4158-8b43-9d9a508fa2cd None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:46.634105 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfed37-7095-4acb-b0a1-5a94f3e7d13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:46.635226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfed37-7095-4acb-b0a1-5a94f3e7d13b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:46.635705 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfed37-7095-4acb-b0a1-5a94f3e7d13b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:46.636175 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfed37-7095-4acb-b0a1-5a94f3e7d13b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:46.639612 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:46.653766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfed37-7095-4acb-b0a1-5a94f3e7d13b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-a3bfed37-7095-4acb-b0a1-5a94f3e7d13b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:46.659528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:46.660445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:46.661266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:46.661266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:46.661266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:46.661266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:46.661266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:46.661266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:46.661266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:46.661266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:46.661266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:46.661266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:46.661266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:46.661266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:46.661266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 195/389] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:46.669625 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfed37-7095-4acb-b0a1-5a94f3e7d13b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:46.711199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05099e72-ebed-4158-8b43-9d9a508fa2cd None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:46.765239 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a476c4a-5d60-450b-a07c-6c388fc476ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:46.766831 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a476c4a-5d60-450b-a07c-6c388fc476ca None admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:46.767317 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a476c4a-5d60-450b-a07c-6c388fc476ca None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:46.767785 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a476c4a-5d60-450b-a07c-6c388fc476ca None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36/groups/fb381ccab4c04e6480a7eeac0c3c169c/roles/c483c855d04b4145a203e1f0eedf3c0c` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:46.770234 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a476c4a-5d60-450b-a07c-6c388fc476ca None admin] RBAC: Authorizing `identity:create_grant(project_id=da2d23ccca37438b90e87196aa0fbe36, group_id=fb381ccab4c04e6480a7eeac0c3c169c, role_id=c483c855d04b4145a203e1f0eedf3c0c)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:46.772069 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a476c4a-5d60-450b-a07c-6c388fc476ca None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:46.789213 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfed37-7095-4acb-b0a1-5a94f3e7d13b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:46.796470 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 195/390] 10.222.0.60 () {58 vars in 1442 bytes} [Tue Jul 26 10:13:46 2022] PUT /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36/groups/fb381ccab4c04e6480a7eeac0c3c169c/roles/c483c855d04b4145a203e1f0eedf3c0c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:46.822354 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:46.829159 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e294d1-aaae-4bf2-9187-c7151462a1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:46.829803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e294d1-aaae-4bf2-9187-c7151462a1dc None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:46.830087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e294d1-aaae-4bf2-9187-c7151462a1dc None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:46.830364 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e294d1-aaae-4bf2-9187-c7151462a1dc None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:46.831159 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e294d1-aaae-4bf2-9187-c7151462a1dc None admin] RBAC: Adding query filter params (name=member) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:46.831469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e294d1-aaae-4bf2-9187-c7151462a1dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:46.832877 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e294d1-aaae-4bf2-9187-c7151462a1dc None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:46.843333 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 196/391] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:46.849673 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a476c4a-5d60-450b-a07c-6c388fc476ca None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:46.997240 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a476c4a-5d60-450b-a07c-6c388fc476ca None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:47.032155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:47.063197 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f9c79-a0d2-44f4-ae30-976c9361cd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:47.063884 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9c79-a0d2-44f4-ae30-976c9361cd34 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:47.064218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9c79-a0d2-44f4-ae30-976c9361cd34 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:47.064488 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9c79-a0d2-44f4-ae30-976c9361cd34 None admin] PATH_INFO: `/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:47.065706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f9c79-a0d2-44f4-ae30-976c9361cd34 None admin] RBAC: Authorizing `identity:get_group(group_id=fb381ccab4c04e6480a7eeac0c3c169c)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:47.067259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f9c79-a0d2-44f4-ae30-976c9361cd34 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:47.069403 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 196/392] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Jul 26 10:13:46 2022] GET /identity/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:47.075060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e294d1-aaae-4bf2-9187-c7151462a1dc None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:47.192208 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e294d1-aaae-4bf2-9187-c7151462a1dc None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:47.230596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc02758-47ff-4f6f-a574-c00f11e15522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:47.231265 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc02758-47ff-4f6f-a574-c00f11e15522 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:47.231541 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc02758-47ff-4f6f-a574-c00f11e15522 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:47.231883 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc02758-47ff-4f6f-a574-c00f11e15522 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:47.233087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc02758-47ff-4f6f-a574-c00f11e15522 None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:47.234579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc02758-47ff-4f6f-a574-c00f11e15522 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:47.239955 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 197/393] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:47 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:47.243541 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f9c79-a0d2-44f4-ae30-976c9361cd34 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:47.440190 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f9c79-a0d2-44f4-ae30-976c9361cd34 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:47.486144 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa9a1c-56fe-4f25-a59d-a51a20650b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:47.487283 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa9a1c-56fe-4f25-a59d-a51a20650b6a None admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:47.487757 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa9a1c-56fe-4f25-a59d-a51a20650b6a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:47.488283 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa9a1c-56fe-4f25-a59d-a51a20650b6a None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1/groups/fb381ccab4c04e6480a7eeac0c3c169c/roles/c483c855d04b4145a203e1f0eedf3c0c` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:47.495324 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa9a1c-56fe-4f25-a59d-a51a20650b6a None admin] RBAC: Authorizing `identity:create_grant(project_id=63fd00e8a9034be59d866bb49c6a5cf1, group_id=fb381ccab4c04e6480a7eeac0c3c169c, role_id=c483c855d04b4145a203e1f0eedf3c0c)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:47.497079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa9a1c-56fe-4f25-a59d-a51a20650b6a None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:47.514807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 197/394] 10.222.0.60 () {58 vars in 1442 bytes} [Tue Jul 26 10:13:47 2022] PUT /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1/groups/fb381ccab4c04e6480a7eeac0c3c169c/roles/c483c855d04b4145a203e1f0eedf3c0c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:48.007076 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af037f-3aa0-4355-804e-847d027b8706 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.007598 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af037f-3aa0-4355-804e-847d027b8706 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.007598 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af037f-3aa0-4355-804e-847d027b8706 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.009296 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 198/395] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:48.015216 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91b929-bfe2-4f5e-b07f-90507682f98f None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.015731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91b929-bfe2-4f5e-b07f-90507682f98f None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.015731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91b929-bfe2-4f5e-b07f-90507682f98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.044895 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-4e91b929-bfe2-4f5e-b07f-90507682f98f None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:48.046181 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-4e91b929-bfe2-4f5e-b07f-90507682f98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:48.111170 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:48.147983 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 198/396] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:48.180637 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af037f-3aa0-4355-804e-847d027b8706 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:48.190226 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef20aa7-8ee2-4341-aaaa-15ede35dab35 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.190564 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef20aa7-8ee2-4341-aaaa-15ede35dab35 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.190807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef20aa7-8ee2-4341-aaaa-15ede35dab35 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.192374 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 199/397] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:48.198782 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a2bf4-506f-4f66-af38-30c6f138533b None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.199059 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a2bf4-506f-4f66-af38-30c6f138533b None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.199496 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a2bf4-506f-4f66-af38-30c6f138533b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.225411 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-9d6a2bf4-506f-4f66-af38-30c6f138533b None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:48.229223 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-9d6a2bf4-506f-4f66-af38-30c6f138533b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:48.315213 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:48.332476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 200/398] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:48.375650 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af037f-3aa0-4355-804e-847d027b8706 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:48.380322 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a2bf4-506f-4f66-af38-30c6f138533b None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:48.414177 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444788a-ef00-43fd-ba43-6a1ba6dcfdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:48.415139 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444788a-ef00-43fd-ba43-6a1ba6dcfdad None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.415555 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444788a-ef00-43fd-ba43-6a1ba6dcfdad None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.416038 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444788a-ef00-43fd-ba43-6a1ba6dcfdad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.428118 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444788a-ef00-43fd-ba43-6a1ba6dcfdad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-4444788a-ef00-43fd-ba43-6a1ba6dcfdad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:48.436915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:48.437898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:48.438777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:48.438777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:48.438777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:48.438777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:48.438777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:48.438777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:48.438777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:48.438777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:48.438777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:48.438777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:48.438777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:48.438777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:48.441817 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 199/399] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:48.448358 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444788a-ef00-43fd-ba43-6a1ba6dcfdad None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:48.606765 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a2bf4-506f-4f66-af38-30c6f138533b None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:48.619733 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:48.674383 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444788a-ef00-43fd-ba43-6a1ba6dcfdad None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:48.682496 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34fbb7-1cdc-42b7-bf9f-a640fa97977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:48.683523 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34fbb7-1cdc-42b7-bf9f-a640fa97977f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.683996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34fbb7-1cdc-42b7-bf9f-a640fa97977f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.684490 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34fbb7-1cdc-42b7-bf9f-a640fa97977f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.696856 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34fbb7-1cdc-42b7-bf9f-a640fa97977f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-6a34fbb7-1cdc-42b7-bf9f-a640fa97977f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:48.702397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:48.703346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:48.704145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:48.704145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:48.704145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:48.704145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:48.704145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:48.704145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:48.704145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:48.704145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:48.704145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:48.704145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:48.704145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:48.704145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:48.706835 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 201/400] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:48.713251 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34fbb7-1cdc-42b7-bf9f-a640fa97977f None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:48.720715 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:48.747741 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2df4bf-1e4c-43c9-b61e-311271b74e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:48.748745 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2df4bf-1e4c-43c9-b61e-311271b74e90 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.749214 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2df4bf-1e4c-43c9-b61e-311271b74e90 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.749709 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2df4bf-1e4c-43c9-b61e-311271b74e90 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.750771 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2df4bf-1e4c-43c9-b61e-311271b74e90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:48.751325 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2df4bf-1e4c-43c9-b61e-311271b74e90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:48.753062 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2df4bf-1e4c-43c9-b61e-311271b74e90 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:48.766311 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 200/401] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:48.768107 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d990b-eeec-4869-acb4-5118af362525 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.768393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d990b-eeec-4869-acb4-5118af362525 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.768669 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d990b-eeec-4869-acb4-5118af362525 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.770583 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 201/402] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:48.774657 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d990b-eeec-4869-acb4-5118af362525 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:48.876587 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34fbb7-1cdc-42b7-bf9f-a640fa97977f None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:48.917995 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d990b-eeec-4869-acb4-5118af362525 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:48.925963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382d380-219a-4bc0-a904-f78eeb3c9c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:48.927008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382d380-219a-4bc0-a904-f78eeb3c9c85 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.927472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382d380-219a-4bc0-a904-f78eeb3c9c85 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.927859 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382d380-219a-4bc0-a904-f78eeb3c9c85 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.928688 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382d380-219a-4bc0-a904-f78eeb3c9c85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:48.929087 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382d380-219a-4bc0-a904-f78eeb3c9c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:48.930614 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382d380-219a-4bc0-a904-f78eeb3c9c85 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:48.939958 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 202/403] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:48.941259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d4bcd-267f-4150-bc45-30d6abb5c040 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.941635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d4bcd-267f-4150-bc45-30d6abb5c040 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.942004 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d4bcd-267f-4150-bc45-30d6abb5c040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.960939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020298cc-5850-4ebb-88da-9d74b13b22f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:48.961919 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020298cc-5850-4ebb-88da-9d74b13b22f5 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.962357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020298cc-5850-4ebb-88da-9d74b13b22f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.962788 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020298cc-5850-4ebb-88da-9d74b13b22f5 None admin] PATH_INFO: `/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.963231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-0d7d4bcd-267f-4150-bc45-30d6abb5c040 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:48.964358 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020298cc-5850-4ebb-88da-9d74b13b22f5 None admin] RBAC: Authorizing `identity:get_group(group_id=fb381ccab4c04e6480a7eeac0c3c169c)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:48.964612 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-0d7d4bcd-267f-4150-bc45-30d6abb5c040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:48.966246 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020298cc-5850-4ebb-88da-9d74b13b22f5 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:48.969877 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 202/404] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Jul 26 10:13:48 2022] GET /identity/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:48.970945 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020298cc-5850-4ebb-88da-9d74b13b22f5 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:48.993365 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:49.048620 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:49.055804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 203/405] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:49.059306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d4bcd-267f-4150-bc45-30d6abb5c040 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:49.104613 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020298cc-5850-4ebb-88da-9d74b13b22f5 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.139943 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc11871-ed82-4a6b-b149-fb4c369d2cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.140716 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11871-ed82-4a6b-b149-fb4c369d2cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.141054 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11871-ed82-4a6b-b149-fb4c369d2cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.141394 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11871-ed82-4a6b-b149-fb4c369d2cd4 None admin] PATH_INFO: `/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.142740 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc11871-ed82-4a6b-b149-fb4c369d2cd4 None admin] RBAC: Authorizing `identity:get_group(group_id=fb381ccab4c04e6480a7eeac0c3c169c)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:49.144304 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc11871-ed82-4a6b-b149-fb4c369d2cd4 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:49.146309 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 203/406] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Jul 26 10:13:48 2022] GET /identity/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:49.147353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc11871-ed82-4a6b-b149-fb4c369d2cd4 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:49.188100 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d4bcd-267f-4150-bc45-30d6abb5c040 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.224307 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e9c2b-9fbb-4256-be20-0d5b56852ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.225327 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e9c2b-9fbb-4256-be20-0d5b56852ac3 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.225769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e9c2b-9fbb-4256-be20-0d5b56852ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.226228 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e9c2b-9fbb-4256-be20-0d5b56852ac3 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.227607 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e9c2b-9fbb-4256-be20-0d5b56852ac3 None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:49.229234 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e9c2b-9fbb-4256-be20-0d5b56852ac3 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:49.231569 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 204/407] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:49 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:49.232559 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e9c2b-9fbb-4256-be20-0d5b56852ac3 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:49.261361 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc11871-ed82-4a6b-b149-fb4c369d2cd4 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.265196 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:49.301231 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c6b63-6ed8-4e15-9ec7-af317aa1a4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.301890 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c6b63-6ed8-4e15-9ec7-af317aa1a4ce None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.302224 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c6b63-6ed8-4e15-9ec7-af317aa1a4ce None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.302455 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c6b63-6ed8-4e15-9ec7-af317aa1a4ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.314674 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:49.318995 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c6b63-6ed8-4e15-9ec7-af317aa1a4ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-ed7c6b63-6ed8-4e15-9ec7-af317aa1a4ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:49.327758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:49.329114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:49.330216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:49.330216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:49.330216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:49.330216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:49.330216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:49.330216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:49.330216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:49.330216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:49.330216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:49.330216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:49.330216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:49.330216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:49.330216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 204/408] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:49.331773 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c6b63-6ed8-4e15-9ec7-af317aa1a4ce None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:49.364405 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e9c2b-9fbb-4256-be20-0d5b56852ac3 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.407143 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5d3f5-2910-41bd-b2ba-8cb5c0962585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.408125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5d3f5-2910-41bd-b2ba-8cb5c0962585 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.408610 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5d3f5-2910-41bd-b2ba-8cb5c0962585 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.409082 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5d3f5-2910-41bd-b2ba-8cb5c0962585 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.410451 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5d3f5-2910-41bd-b2ba-8cb5c0962585 None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:49.412707 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5d3f5-2910-41bd-b2ba-8cb5c0962585 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:49.415929 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 205/409] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:49 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:49.416933 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5d3f5-2910-41bd-b2ba-8cb5c0962585 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:49.460826 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c6b63-6ed8-4e15-9ec7-af317aa1a4ce None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.513621 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8c1e7-1585-47f5-894a-c6167bf25568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.514344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8c1e7-1585-47f5-894a-c6167bf25568 None admin] REQUEST_METHOD: `PUT` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.514657 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8c1e7-1585-47f5-894a-c6167bf25568 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.514935 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8c1e7-1585-47f5-894a-c6167bf25568 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36/groups/fb381ccab4c04e6480a7eeac0c3c169c/roles/2ae24c72c8264d0ba34cbe573083cc33` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.517304 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8c1e7-1585-47f5-894a-c6167bf25568 None admin] RBAC: Authorizing `identity:create_grant(project_id=da2d23ccca37438b90e87196aa0fbe36, group_id=fb381ccab4c04e6480a7eeac0c3c169c, role_id=2ae24c72c8264d0ba34cbe573083cc33)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:49.518875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8c1e7-1585-47f5-894a-c6167bf25568 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:49.535949 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 205/410] 10.222.0.60 () {58 vars in 1442 bytes} [Tue Jul 26 10:13:49 2022] PUT /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36/groups/fb381ccab4c04e6480a7eeac0c3c169c/roles/2ae24c72c8264d0ba34cbe573083cc33 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:49.536666 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8c1e7-1585-47f5-894a-c6167bf25568 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:49.553649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:49.564033 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5d3f5-2910-41bd-b2ba-8cb5c0962585 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.585860 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:49.609473 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52326864-330e-447a-9a2a-dc0c0e7509ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.610511 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52326864-330e-447a-9a2a-dc0c0e7509ef None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.611114 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52326864-330e-447a-9a2a-dc0c0e7509ef None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.611611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52326864-330e-447a-9a2a-dc0c0e7509ef None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.612824 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52326864-330e-447a-9a2a-dc0c0e7509ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:49.613385 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52326864-330e-447a-9a2a-dc0c0e7509ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:49.615085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52326864-330e-447a-9a2a-dc0c0e7509ef None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:49.626191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 206/411] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:49.631519 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52326864-330e-447a-9a2a-dc0c0e7509ef None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:49.728061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8c1e7-1585-47f5-894a-c6167bf25568 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.763350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52326864-330e-447a-9a2a-dc0c0e7509ef None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.774417 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edf67a-4138-4f78-9db8-06c5c00067f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.775137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edf67a-4138-4f78-9db8-06c5c00067f8 None admin] REQUEST_METHOD: `PUT` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.775535 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edf67a-4138-4f78-9db8-06c5c00067f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.775818 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edf67a-4138-4f78-9db8-06c5c00067f8 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1/groups/fb381ccab4c04e6480a7eeac0c3c169c/roles/2ae24c72c8264d0ba34cbe573083cc33` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.781612 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23edf67a-4138-4f78-9db8-06c5c00067f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=63fd00e8a9034be59d866bb49c6a5cf1, group_id=fb381ccab4c04e6480a7eeac0c3c169c, role_id=2ae24c72c8264d0ba34cbe573083cc33)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:49.781612 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23edf67a-4138-4f78-9db8-06c5c00067f8 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:49.795910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 206/412] 10.222.0.60 () {58 vars in 1442 bytes} [Tue Jul 26 10:13:49 2022] PUT /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1/groups/fb381ccab4c04e6480a7eeac0c3c169c/roles/2ae24c72c8264d0ba34cbe573083cc33 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:49.796996 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d4f09-9407-4892-af48-9285b9afb5a1 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.797375 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d4f09-9407-4892-af48-9285b9afb5a1 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.797554 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d4f09-9407-4892-af48-9285b9afb5a1 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.799134 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 207/413] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:49.804895 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bf7d8-aaea-4b77-97cf-82e36bc1cc33 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.805201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bf7d8-aaea-4b77-97cf-82e36bc1cc33 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.805454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bf7d8-aaea-4b77-97cf-82e36bc1cc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.806675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785969d0-3247-4810-92bd-00cb7c872fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.807652 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785969d0-3247-4810-92bd-00cb7c872fd7 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.808139 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785969d0-3247-4810-92bd-00cb7c872fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.808704 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785969d0-3247-4810-92bd-00cb7c872fd7 None admin] PATH_INFO: `/v3/groups/0405d31a084842cca2b746fe0c7ec214` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.810558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785969d0-3247-4810-92bd-00cb7c872fd7 None admin] RBAC: Authorizing `identity:get_group(group_id=0405d31a084842cca2b746fe0c7ec214)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:49.812432 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785969d0-3247-4810-92bd-00cb7c872fd7 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:49.814751 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 207/414] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Jul 26 10:13:49 2022] GET /identity/v3/groups/0405d31a084842cca2b746fe0c7ec214 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:49.820365 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785969d0-3247-4810-92bd-00cb7c872fd7 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:49.831436 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-0f1bf7d8-aaea-4b77-97cf-82e36bc1cc33 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:49.832990 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-0f1bf7d8-aaea-4b77-97cf-82e36bc1cc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:49.851264 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:49.937364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785969d0-3247-4810-92bd-00cb7c872fd7 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.964097 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 208/415] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:49.990925 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67eb46-6cce-4597-960d-bba159dc2968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.991506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67eb46-6cce-4597-960d-bba159dc2968 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.991785 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67eb46-6cce-4597-960d-bba159dc2968 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.994874 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67eb46-6cce-4597-960d-bba159dc2968 None admin] PATH_INFO: `/v3/projects/a699385ce385472fabea3d65e4ca80c6` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.996255 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67eb46-6cce-4597-960d-bba159dc2968 None admin] RBAC: Authorizing `identity:get_project(project_id=a699385ce385472fabea3d65e4ca80c6)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:49.997885 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67eb46-6cce-4597-960d-bba159dc2968 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:49.999991 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 208/416] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:49 2022] GET /identity/v3/projects/a699385ce385472fabea3d65e4ca80c6 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:50.005994 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bf7d8-aaea-4b77-97cf-82e36bc1cc33 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:50.024521 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67eb46-6cce-4597-960d-bba159dc2968 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:50.046841 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:50.133444 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:50.144781 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bf7d8-aaea-4b77-97cf-82e36bc1cc33 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:50.145894 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67eb46-6cce-4597-960d-bba159dc2968 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:50.183958 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d15e9-1315-445c-b80b-21a1166ab062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:50.184366 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d15e9-1315-445c-b80b-21a1166ab062 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:50.184647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d15e9-1315-445c-b80b-21a1166ab062 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:50.184954 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d15e9-1315-445c-b80b-21a1166ab062 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:50.189807 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d2a9c-4016-4043-92e4-2bee65e2a3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:50.190783 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d2a9c-4016-4043-92e4-2bee65e2a3df None admin] REQUEST_METHOD: `PUT` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:50.191263 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d2a9c-4016-4043-92e4-2bee65e2a3df None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:50.191729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d2a9c-4016-4043-92e4-2bee65e2a3df None admin] PATH_INFO: `/v3/projects/a699385ce385472fabea3d65e4ca80c6/groups/0405d31a084842cca2b746fe0c7ec214/roles/7d88b748366a42929784db05d53fe473` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:50.193930 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d2a9c-4016-4043-92e4-2bee65e2a3df None admin] RBAC: Authorizing `identity:create_grant(project_id=a699385ce385472fabea3d65e4ca80c6, group_id=0405d31a084842cca2b746fe0c7ec214, role_id=7d88b748366a42929784db05d53fe473)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:50.195629 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d2a9c-4016-4043-92e4-2bee65e2a3df None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:50.196819 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d15e9-1315-445c-b80b-21a1166ab062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-913d15e9-1315-445c-b80b-21a1166ab062 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:50.208825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:50.209837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:50.210672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:50.210672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:50.210672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:50.210672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:50.210672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:50.210672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:50.210672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:50.210672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:50.210672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:50.210672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:50.210672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:50.210672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:50.210672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 209/417] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:50.210672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d15e9-1315-445c-b80b-21a1166ab062 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:50.222646 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 209/418] 10.222.0.60 () {58 vars in 1442 bytes} [Tue Jul 26 10:13:50 2022] PUT /identity/v3/projects/a699385ce385472fabea3d65e4ca80c6/groups/0405d31a084842cca2b746fe0c7ec214/roles/7d88b748366a42929784db05d53fe473 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:50.344177 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d15e9-1315-445c-b80b-21a1166ab062 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:50.381895 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05679b31-ce76-407a-ad61-fbc02d5f4ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:50.382563 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05679b31-ce76-407a-ad61-fbc02d5f4ad8 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:50.382842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05679b31-ce76-407a-ad61-fbc02d5f4ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:50.383113 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05679b31-ce76-407a-ad61-fbc02d5f4ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:50.383847 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05679b31-ce76-407a-ad61-fbc02d5f4ad8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:50.384152 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05679b31-ce76-407a-ad61-fbc02d5f4ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:50.385610 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05679b31-ce76-407a-ad61-fbc02d5f4ad8 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:50.396268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 210/419] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:50.402011 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d2a9c-4016-4043-92e4-2bee65e2a3df None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:50.551506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:50.571528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d2a9c-4016-4043-92e4-2bee65e2a3df None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:50.628627 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab67dd5-0dea-4285-b4f8-b1b37380cfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:50.629242 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab67dd5-0dea-4285-b4f8-b1b37380cfa8 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:50.629569 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab67dd5-0dea-4285-b4f8-b1b37380cfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:50.629843 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab67dd5-0dea-4285-b4f8-b1b37380cfa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:50.729097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317cabe-6650-4cea-890a-008337a2027a None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:50.729763 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317cabe-6650-4cea-890a-008337a2027a None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:50.730234 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317cabe-6650-4cea-890a-008337a2027a None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:50.732138 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 211/420] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:50.737475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870106e0-aba1-4beb-a35e-585ac81d6202 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:50.738006 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870106e0-aba1-4beb-a35e-585ac81d6202 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:50.738543 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870106e0-aba1-4beb-a35e-585ac81d6202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:50.742144 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab67dd5-0dea-4285-b4f8-b1b37380cfa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:50.743666 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab67dd5-0dea-4285-b4f8-b1b37380cfa8 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:50.764515 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-870106e0-aba1-4beb-a35e-585ac81d6202 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:50.768200 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-870106e0-aba1-4beb-a35e-585ac81d6202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:50.786735 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:50.898002 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 212/421] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:50.909092 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:50.926869 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 210/422] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:50.932610 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870106e0-aba1-4beb-a35e-585ac81d6202 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:50.962147 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab67dd5-0dea-4285-b4f8-b1b37380cfa8 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:51.107587 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab67dd5-0dea-4285-b4f8-b1b37380cfa8 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:51.146365 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ad182-c2bc-4dae-9824-b274e8eaaad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:51.147969 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ad182-c2bc-4dae-9824-b274e8eaaad2 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:51.148515 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ad182-c2bc-4dae-9824-b274e8eaaad2 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:51.148979 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ad182-c2bc-4dae-9824-b274e8eaaad2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:51.160380 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ad182-c2bc-4dae-9824-b274e8eaaad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-b45ad182-c2bc-4dae-9824-b274e8eaaad2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:51.166563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:51.167440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:51.168271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:51.168271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:51.168271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:51.168271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:51.168271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:51.168271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:51.168271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:51.168271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:51.168271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:51.168271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:51.168271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:13:51.168271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:51.171120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 211/423] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:51.179664 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ad182-c2bc-4dae-9824-b274e8eaaad2 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:51.198659 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870106e0-aba1-4beb-a35e-585ac81d6202 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:51.258954 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:51.280814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0eb28-f1d1-45ab-8818-19d4fe7f7f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:51.281485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0eb28-f1d1-45ab-8818-19d4fe7f7f27 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:51.281763 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0eb28-f1d1-45ab-8818-19d4fe7f7f27 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:51.282037 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0eb28-f1d1-45ab-8818-19d4fe7f7f27 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:51.283275 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0eb28-f1d1-45ab-8818-19d4fe7f7f27 None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:51.284727 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0eb28-f1d1-45ab-8818-19d4fe7f7f27 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:51.286581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 213/424] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:50 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:51.293430 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0eb28-f1d1-45ab-8818-19d4fe7f7f27 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:51.322885 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:51.340261 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ad182-c2bc-4dae-9824-b274e8eaaad2 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:51.410062 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d497a5-384c-4267-b791-681accac00b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:51.410639 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d497a5-384c-4267-b791-681accac00b4 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:51.410966 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d497a5-384c-4267-b791-681accac00b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:51.411239 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d497a5-384c-4267-b791-681accac00b4 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:51.412289 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d497a5-384c-4267-b791-681accac00b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:51.412728 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d497a5-384c-4267-b791-681accac00b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:51.414647 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d497a5-384c-4267-b791-681accac00b4 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:51.440176 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 212/425] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:51.443389 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d497a5-384c-4267-b791-681accac00b4 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:51.488395 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0eb28-f1d1-45ab-8818-19d4fe7f7f27 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:51.551399 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e42dd-decb-44df-9357-72d11c09c72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:51.552060 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e42dd-decb-44df-9357-72d11c09c72d None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:51.552335 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e42dd-decb-44df-9357-72d11c09c72d None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:51.552608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e42dd-decb-44df-9357-72d11c09c72d None admin] PATH_INFO: `/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:51.554467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e42dd-decb-44df-9357-72d11c09c72d None admin] RBAC: Authorizing `identity:get_group(group_id=fb381ccab4c04e6480a7eeac0c3c169c)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:51.560050 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e42dd-decb-44df-9357-72d11c09c72d None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:51.562082 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 214/426] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Jul 26 10:13:51 2022] GET /identity/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:51.569411 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e42dd-decb-44df-9357-72d11c09c72d None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:51.613834 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d497a5-384c-4267-b791-681accac00b4 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:51.646807 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:51.709850 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1331a8-1b31-4026-a1f0-062301a4821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:51.710422 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1331a8-1b31-4026-a1f0-062301a4821d None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:51.710741 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1331a8-1b31-4026-a1f0-062301a4821d None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:51.711008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1331a8-1b31-4026-a1f0-062301a4821d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:51.756198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:51.793897 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e42dd-decb-44df-9357-72d11c09c72d None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:51.841727 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1331a8-1b31-4026-a1f0-062301a4821d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:51.843239 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1331a8-1b31-4026-a1f0-062301a4821d None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:51.860030 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7ba92-df6a-4f7e-bd93-307bcd26e91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:51.860729 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7ba92-df6a-4f7e-bd93-307bcd26e91c None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:51.861006 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7ba92-df6a-4f7e-bd93-307bcd26e91c None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:51.861278 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7ba92-df6a-4f7e-bd93-307bcd26e91c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:51.862134 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7ba92-df6a-4f7e-bd93-307bcd26e91c None admin] RBAC: Adding query filter params (group.id=fb381ccab4c04e6480a7eeac0c3c169c, role.id=c483c855d04b4145a203e1f0eedf3c0c, scope.project.id=da2d23ccca37438b90e87196aa0fbe36) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:51.862463 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7ba92-df6a-4f7e-bd93-307bcd26e91c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:51.864066 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7ba92-df6a-4f7e-bd93-307bcd26e91c None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:51.875599 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 215/427] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Jul 26 10:13:51 2022] GET /identity/v3/role_assignments?group.id=fb381ccab4c04e6480a7eeac0c3c169c&scope.project.id=da2d23ccca37438b90e87196aa0fbe36&role.id=c483c855d04b4145a203e1f0eedf3c0c => generated 611 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:51.989860 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 213/428] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:13:51.995843 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7ba92-df6a-4f7e-bd93-307bcd26e91c None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:52.123878 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7ba92-df6a-4f7e-bd93-307bcd26e91c None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:52.180700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870bd98-86b9-4c19-a32e-8f1d56af473a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:52.181522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870bd98-86b9-4c19-a32e-8f1d56af473a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.181805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870bd98-86b9-4c19-a32e-8f1d56af473a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.182085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870bd98-86b9-4c19-a32e-8f1d56af473a None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.183400 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870bd98-86b9-4c19-a32e-8f1d56af473a None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:52.184998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870bd98-86b9-4c19-a32e-8f1d56af473a None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:52.186737 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 216/429] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:51 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:52.192588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1331a8-1b31-4026-a1f0-062301a4821d None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:52.203074 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647616b8-b52f-4acc-899e-1fa097387e20 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.203602 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647616b8-b52f-4acc-899e-1fa097387e20 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.203602 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647616b8-b52f-4acc-899e-1fa097387e20 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.207654 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 217/430] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:52.211453 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:52.214800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800e0b2-fecc-45bb-809a-203872299cf7 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.215086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800e0b2-fecc-45bb-809a-203872299cf7 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.215358 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800e0b2-fecc-45bb-809a-203872299cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.249047 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-a800e0b2-fecc-45bb-809a-203872299cf7 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:52.250186 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-a800e0b2-fecc-45bb-809a-203872299cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:52.259834 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:52.330766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1331a8-1b31-4026-a1f0-062301a4821d None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:52.349257 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 218/431] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:52.373636 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9713e-c2b5-4ce9-8dee-a008f320a3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:52.374250 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800e0b2-fecc-45bb-809a-203872299cf7 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:52.374358 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9713e-c2b5-4ce9-8dee-a008f320a3a2 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.374666 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9713e-c2b5-4ce9-8dee-a008f320a3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.374946 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9713e-c2b5-4ce9-8dee-a008f320a3a2 None admin] PATH_INFO: `/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.376384 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9713e-c2b5-4ce9-8dee-a008f320a3a2 None admin] RBAC: Authorizing `identity:get_group(group_id=fb381ccab4c04e6480a7eeac0c3c169c)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:52.377959 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9713e-c2b5-4ce9-8dee-a008f320a3a2 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:52.384868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 214/432] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Jul 26 10:13:52 2022] GET /identity/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:52.386222 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9713e-c2b5-4ce9-8dee-a008f320a3a2 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:52.483091 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:52.492572 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800e0b2-fecc-45bb-809a-203872299cf7 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:52.507922 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9713e-c2b5-4ce9-8dee-a008f320a3a2 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:52.533868 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d78dd7-8516-4007-8d0a-c70ef78f6eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:52.534568 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d78dd7-8516-4007-8d0a-c70ef78f6eda None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.534831 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d78dd7-8516-4007-8d0a-c70ef78f6eda None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.535094 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d78dd7-8516-4007-8d0a-c70ef78f6eda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.549242 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d78dd7-8516-4007-8d0a-c70ef78f6eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-24d78dd7-8516-4007-8d0a-c70ef78f6eda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:52.555542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:52.556624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:52.557591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:52.557591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:52.557591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:52.557591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:52.557591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:52.557591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:52.557591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:52.557591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:52.557591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:52.557591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:52.557591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:52.557591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:52.559722 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 219/433] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:52.561195 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac2770-bc44-4a87-acea-4ce973b71b46 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.561486 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac2770-bc44-4a87-acea-4ce973b71b46 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.561761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac2770-bc44-4a87-acea-4ce973b71b46 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.562496 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518fd48-b476-4e0c-b9bc-89e370be6bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:52.563275 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 220/434] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:52.563609 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518fd48-b476-4e0c-b9bc-89e370be6bfa None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.563901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518fd48-b476-4e0c-b9bc-89e370be6bfa None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.564255 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518fd48-b476-4e0c-b9bc-89e370be6bfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.565400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518fd48-b476-4e0c-b9bc-89e370be6bfa None admin] RBAC: Adding query filter params (group.id=fb381ccab4c04e6480a7eeac0c3c169c, role.id=c483c855d04b4145a203e1f0eedf3c0c, scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:52.565726 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518fd48-b476-4e0c-b9bc-89e370be6bfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:52.566088 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac2770-bc44-4a87-acea-4ce973b71b46 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:52.567309 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518fd48-b476-4e0c-b9bc-89e370be6bfa None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:52.569558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:52.578530 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 215/435] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Jul 26 10:13:52 2022] GET /identity/v3/role_assignments?group.id=fb381ccab4c04e6480a7eeac0c3c169c&scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1&role.id=c483c855d04b4145a203e1f0eedf3c0c => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:52.580374 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f42e42-1bfd-4d7e-80b1-6c7c3a230a18 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.580891 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f42e42-1bfd-4d7e-80b1-6c7c3a230a18 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.581354 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f42e42-1bfd-4d7e-80b1-6c7c3a230a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.610542 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-90f42e42-1bfd-4d7e-80b1-6c7c3a230a18 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:52.613578 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-90f42e42-1bfd-4d7e-80b1-6c7c3a230a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:52.705668 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 216/436] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:52.713367 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac2770-bc44-4a87-acea-4ce973b71b46 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:52.735795 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f42e42-1bfd-4d7e-80b1-6c7c3a230a18 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:52.757396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92459481-91fd-4393-9574-c9f82bcd4b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:52.758919 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92459481-91fd-4393-9574-c9f82bcd4b5b None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.759410 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92459481-91fd-4393-9574-c9f82bcd4b5b None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.759896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92459481-91fd-4393-9574-c9f82bcd4b5b None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.760878 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92459481-91fd-4393-9574-c9f82bcd4b5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:52.761380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92459481-91fd-4393-9574-c9f82bcd4b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:52.763244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92459481-91fd-4393-9574-c9f82bcd4b5b None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:52.776662 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 221/437] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:52.783111 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92459481-91fd-4393-9574-c9f82bcd4b5b None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:52.833014 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:52.871572 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f42e42-1bfd-4d7e-80b1-6c7c3a230a18 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:52.877820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:52.929025 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92459481-91fd-4393-9574-c9f82bcd4b5b None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:52.931090 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea154c-2c2d-44e4-a2c3-859e7c7c8614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:52.932037 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea154c-2c2d-44e4-a2c3-859e7c7c8614 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.932492 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea154c-2c2d-44e4-a2c3-859e7c7c8614 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.932933 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea154c-2c2d-44e4-a2c3-859e7c7c8614 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.945403 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea154c-2c2d-44e4-a2c3-859e7c7c8614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-f2ea154c-2c2d-44e4-a2c3-859e7c7c8614 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:52.950914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:52.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:52.952649 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:52.952649 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:52.952649 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:52.952649 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:52.952649 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:52.952649 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:52.952649 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:52.952649 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:52.952649 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:52.952649 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:52.952649 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:13:52.952649 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:13:52.954832 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 217/438] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:52.960995 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea154c-2c2d-44e4-a2c3-859e7c7c8614 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:52.962496 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b29c12-370e-469e-b2b2-e0b1f0f40559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:52.963129 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b29c12-370e-469e-b2b2-e0b1f0f40559 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.963406 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b29c12-370e-469e-b2b2-e0b1f0f40559 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.963700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b29c12-370e-469e-b2b2-e0b1f0f40559 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.039976 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b29c12-370e-469e-b2b2-e0b1f0f40559 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.041452 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b29c12-370e-469e-b2b2-e0b1f0f40559 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.074222 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea154c-2c2d-44e4-a2c3-859e7c7c8614 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.102451 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:53.103149 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:53.108924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3cb1c-94e7-4a35-8b41-49b5bf00573a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.109551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3cb1c-94e7-4a35-8b41-49b5bf00573a None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.109832 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3cb1c-94e7-4a35-8b41-49b5bf00573a None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.110108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3cb1c-94e7-4a35-8b41-49b5bf00573a None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.110876 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3cb1c-94e7-4a35-8b41-49b5bf00573a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:53.111179 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3cb1c-94e7-4a35-8b41-49b5bf00573a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.112602 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3cb1c-94e7-4a35-8b41-49b5bf00573a None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.120765 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 218/439] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:53.121974 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b1fd7-1845-4009-b429-2ae911705148 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.122336 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b1fd7-1845-4009-b429-2ae911705148 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.123033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b1fd7-1845-4009-b429-2ae911705148 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.123872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 219/440] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:53.126378 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b1fd7-1845-4009-b429-2ae911705148 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.146678 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 222/441] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:53.147965 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83878d5-8b0f-4d4a-a9b5-cb8466e70ad9 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.148250 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83878d5-8b0f-4d4a-a9b5-cb8466e70ad9 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.148525 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83878d5-8b0f-4d4a-a9b5-cb8466e70ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.169805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-c83878d5-8b0f-4d4a-a9b5-cb8466e70ad9 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:53.171048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-c83878d5-8b0f-4d4a-a9b5-cb8466e70ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:53.235306 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b1fd7-1845-4009-b429-2ae911705148 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.236354 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 223/442] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:53.237215 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83878d5-8b0f-4d4a-a9b5-cb8466e70ad9 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.271446 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888eb2ca-6b73-4060-af52-303217619feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.271988 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888eb2ca-6b73-4060-af52-303217619feb None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.272266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888eb2ca-6b73-4060-af52-303217619feb None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.272539 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888eb2ca-6b73-4060-af52-303217619feb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.331945 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:53.332699 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:53.339701 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83878d5-8b0f-4d4a-a9b5-cb8466e70ad9 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.340548 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888eb2ca-6b73-4060-af52-303217619feb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.342062 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888eb2ca-6b73-4060-af52-303217619feb None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.375372 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4f871-56d4-4b4c-b63d-b34d79292663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.376017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4f871-56d4-4b4c-b63d-b34d79292663 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.376289 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4f871-56d4-4b4c-b63d-b34d79292663 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.376555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4f871-56d4-4b4c-b63d-b34d79292663 None admin] PATH_INFO: `/v3/projects/da2d23ccca37438b90e87196aa0fbe36` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.377809 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4f871-56d4-4b4c-b63d-b34d79292663 None admin] RBAC: Authorizing `identity:get_project(project_id=da2d23ccca37438b90e87196aa0fbe36)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.379305 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4f871-56d4-4b4c-b63d-b34d79292663 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.381000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 224/443] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/projects/da2d23ccca37438b90e87196aa0fbe36 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:53.381753 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4f871-56d4-4b4c-b63d-b34d79292663 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.444032 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 220/444] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:13:53.444890 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888eb2ca-6b73-4060-af52-303217619feb None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.486346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4f871-56d4-4b4c-b63d-b34d79292663 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.519930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46878202-9e42-4795-a8f7-8d4beb038d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.520673 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46878202-9e42-4795-a8f7-8d4beb038d25 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.521020 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46878202-9e42-4795-a8f7-8d4beb038d25 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.521359 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46878202-9e42-4795-a8f7-8d4beb038d25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.535847 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46878202-9e42-4795-a8f7-8d4beb038d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:53.537948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-46878202-9e42-4795-a8f7-8d4beb038d25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:53.541800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:53.542743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:53.543527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:53.543527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:53.543527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:53.543527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:53.543527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:53.543527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:53.543527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:53.543527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:53.543527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:53.543527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:53.543527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:53.543527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:53.543527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 225/445] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:53.544191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46878202-9e42-4795-a8f7-8d4beb038d25 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.550752 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888eb2ca-6b73-4060-af52-303217619feb None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.568545 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:53.587240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b6a5f-39de-4161-bb51-4120aa557070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.587907 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b6a5f-39de-4161-bb51-4120aa557070 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.588184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b6a5f-39de-4161-bb51-4120aa557070 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.588448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b6a5f-39de-4161-bb51-4120aa557070 None admin] PATH_INFO: `/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.589714 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b6a5f-39de-4161-bb51-4120aa557070 None admin] RBAC: Authorizing `identity:get_group(group_id=fb381ccab4c04e6480a7eeac0c3c169c)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.591362 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b6a5f-39de-4161-bb51-4120aa557070 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.592986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 221/446] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:53.593766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b6a5f-39de-4161-bb51-4120aa557070 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.648667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46878202-9e42-4795-a8f7-8d4beb038d25 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.682168 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ad05d-8629-4358-94b0-0b086eb9d972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.682850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ad05d-8629-4358-94b0-0b086eb9d972 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.683128 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ad05d-8629-4358-94b0-0b086eb9d972 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.683399 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ad05d-8629-4358-94b0-0b086eb9d972 None admin] PATH_INFO: `/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.684741 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ad05d-8629-4358-94b0-0b086eb9d972 None admin] RBAC: Authorizing `identity:get_project(project_id=63fd00e8a9034be59d866bb49c6a5cf1)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.686144 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ad05d-8629-4358-94b0-0b086eb9d972 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.687848 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 226/447] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/projects/63fd00e8a9034be59d866bb49c6a5cf1 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:53.688682 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ad05d-8629-4358-94b0-0b086eb9d972 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.699898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b6a5f-39de-4161-bb51-4120aa557070 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.733209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06176210-80cc-46e8-8351-209a40dbb4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.733830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06176210-80cc-46e8-8351-209a40dbb4d8 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.734107 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06176210-80cc-46e8-8351-209a40dbb4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.734372 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06176210-80cc-46e8-8351-209a40dbb4d8 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.735119 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06176210-80cc-46e8-8351-209a40dbb4d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:53.735418 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06176210-80cc-46e8-8351-209a40dbb4d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.736780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06176210-80cc-46e8-8351-209a40dbb4d8 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.744770 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 222/448] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:53.745694 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06176210-80cc-46e8-8351-209a40dbb4d8 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.779197 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:53.784577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:53.796042 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ad05d-8629-4358-94b0-0b086eb9d972 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.831618 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e3371-d7d0-46ca-8550-e883d868fefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.832250 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e3371-d7d0-46ca-8550-e883d868fefd None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.832522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e3371-d7d0-46ca-8550-e883d868fefd None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.832781 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e3371-d7d0-46ca-8550-e883d868fefd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.833569 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e3371-d7d0-46ca-8550-e883d868fefd None admin] RBAC: Adding query filter params (group.id=fb381ccab4c04e6480a7eeac0c3c169c, role.id=2ae24c72c8264d0ba34cbe573083cc33, scope.project.id=da2d23ccca37438b90e87196aa0fbe36) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:53.833868 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e3371-d7d0-46ca-8550-e883d868fefd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.835329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e3371-d7d0-46ca-8550-e883d868fefd None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.841283 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 227/449] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/role_assignments?group.id=fb381ccab4c04e6480a7eeac0c3c169c&scope.project.id=da2d23ccca37438b90e87196aa0fbe36&role.id=2ae24c72c8264d0ba34cbe573083cc33 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:53.842083 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e3371-d7d0-46ca-8550-e883d868fefd None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.860814 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06176210-80cc-46e8-8351-209a40dbb4d8 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.902423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377bb73-bfea-4e0e-b466-114accf83be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.903335 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377bb73-bfea-4e0e-b466-114accf83be5 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.903669 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377bb73-bfea-4e0e-b466-114accf83be5 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.903939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377bb73-bfea-4e0e-b466-114accf83be5 None admin] PATH_INFO: `/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.905388 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377bb73-bfea-4e0e-b466-114accf83be5 None admin] RBAC: Authorizing `identity:get_group(group_id=fb381ccab4c04e6480a7eeac0c3c169c)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.906941 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377bb73-bfea-4e0e-b466-114accf83be5 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.909067 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 223/450] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/groups/fb381ccab4c04e6480a7eeac0c3c169c => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:53.915766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377bb73-bfea-4e0e-b466-114accf83be5 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.978586 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e3371-d7d0-46ca-8550-e883d868fefd None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:54.023948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d5275-b74c-494b-bf3c-d1173952f51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:54.024923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d5275-b74c-494b-bf3c-d1173952f51a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:54.025204 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d5275-b74c-494b-bf3c-d1173952f51a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:54.025477 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d5275-b74c-494b-bf3c-d1173952f51a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:54.050768 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:54.057232 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:54.064668 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377bb73-bfea-4e0e-b466-114accf83be5 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:54.100882 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad75cba-5e28-4736-88a4-f96ff324e244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:54.101525 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad75cba-5e28-4736-88a4-f96ff324e244 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:54.101808 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad75cba-5e28-4736-88a4-f96ff324e244 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:54.102106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad75cba-5e28-4736-88a4-f96ff324e244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:54.103335 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad75cba-5e28-4736-88a4-f96ff324e244 None admin] RBAC: Adding query filter params (group.id=fb381ccab4c04e6480a7eeac0c3c169c, role.id=2ae24c72c8264d0ba34cbe573083cc33, scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:54.103656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad75cba-5e28-4736-88a4-f96ff324e244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:54.105234 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad75cba-5e28-4736-88a4-f96ff324e244 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:54.110472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d5275-b74c-494b-bf3c-d1173952f51a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:54.111669 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d5275-b74c-494b-bf3c-d1173952f51a None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:54.111866 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 224/451] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/role_assignments?group.id=fb381ccab4c04e6480a7eeac0c3c169c&scope.project.id=63fd00e8a9034be59d866bb49c6a5cf1&role.id=2ae24c72c8264d0ba34cbe573083cc33 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:54.235956 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 228/452] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:54.241797 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad75cba-5e28-4736-88a4-f96ff324e244 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:54.385097 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad75cba-5e28-4736-88a4-f96ff324e244 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:54.427479 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28806ab-561c-41b7-ac6d-8095bc0326ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:54.428144 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28806ab-561c-41b7-ac6d-8095bc0326ee None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:54.428418 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28806ab-561c-41b7-ac6d-8095bc0326ee None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:54.428753 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28806ab-561c-41b7-ac6d-8095bc0326ee None admin] PATH_INFO: `/v3/projects/a699385ce385472fabea3d65e4ca80c6` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:54.429865 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28806ab-561c-41b7-ac6d-8095bc0326ee None admin] RBAC: Authorizing `identity:get_project(project_id=a699385ce385472fabea3d65e4ca80c6)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:54.431355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28806ab-561c-41b7-ac6d-8095bc0326ee None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:54.433037 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 225/453] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:54 2022] GET /identity/v3/projects/a699385ce385472fabea3d65e4ca80c6 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:54.438899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d5275-b74c-494b-bf3c-d1173952f51a None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:54.496329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:54.543372 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d5275-b74c-494b-bf3c-d1173952f51a None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:54.587552 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fc3c9-b26a-4eb2-bd6c-53328b43888f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:54.588259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fc3c9-b26a-4eb2-bd6c-53328b43888f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:54.588500 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fc3c9-b26a-4eb2-bd6c-53328b43888f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:54.588773 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fc3c9-b26a-4eb2-bd6c-53328b43888f None admin] PATH_INFO: `/v3/groups/0405d31a084842cca2b746fe0c7ec214` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:54.589976 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fc3c9-b26a-4eb2-bd6c-53328b43888f None admin] RBAC: Authorizing `identity:get_group(group_id=0405d31a084842cca2b746fe0c7ec214)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:54.591585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fc3c9-b26a-4eb2-bd6c-53328b43888f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:54.593221 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 229/454] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Jul 26 10:13:54 2022] GET /identity/v3/groups/0405d31a084842cca2b746fe0c7ec214 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:54.600311 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28806ab-561c-41b7-ac6d-8095bc0326ee None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:54.633992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:54.724136 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28806ab-561c-41b7-ac6d-8095bc0326ee None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:54.761116 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef863a3e-861f-4a3b-af85-08646a6f35fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:54.761719 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef863a3e-861f-4a3b-af85-08646a6f35fa None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:54.761996 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef863a3e-861f-4a3b-af85-08646a6f35fa None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:54.762269 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef863a3e-861f-4a3b-af85-08646a6f35fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:54.763137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef863a3e-861f-4a3b-af85-08646a6f35fa None admin] RBAC: Adding query filter params (group.id=0405d31a084842cca2b746fe0c7ec214, role.id=7d88b748366a42929784db05d53fe473, scope.project.id=a699385ce385472fabea3d65e4ca80c6) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:54.763442 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef863a3e-861f-4a3b-af85-08646a6f35fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:54.764866 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef863a3e-861f-4a3b-af85-08646a6f35fa None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:54.770792 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 226/455] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Jul 26 10:13:54 2022] GET /identity/v3/role_assignments?group.id=0405d31a084842cca2b746fe0c7ec214&scope.project.id=a699385ce385472fabea3d65e4ca80c6&role.id=7d88b748366a42929784db05d53fe473 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:57.316948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88898309-ed84-4ab5-be79-67058563632f None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:57.317976 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88898309-ed84-4ab5-be79-67058563632f None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:57.318500 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88898309-ed84-4ab5-be79-67058563632f None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:57.320410 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 230/456] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:57.326109 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1054387-c77b-422c-a850-b8f2dde50178 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:57.327007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1054387-c77b-422c-a850-b8f2dde50178 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:57.327472 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1054387-c77b-422c-a850-b8f2dde50178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:57.348267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-d1054387-c77b-422c-a850-b8f2dde50178 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:57.349883 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-d1054387-c77b-422c-a850-b8f2dde50178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:57.431234 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 227/457] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:57.456770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88898309-ed84-4ab5-be79-67058563632f None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:57.517863 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ca290-e37a-4fae-8006-91bad26ea58f None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:57.518618 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ca290-e37a-4fae-8006-91bad26ea58f None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:57.519074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ca290-e37a-4fae-8006-91bad26ea58f None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:57.521975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 228/458] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:57.526354 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba5bc3-fbc0-4407-b52f-df142f1cae8b None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:57.526871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba5bc3-fbc0-4407-b52f-df142f1cae8b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:57.527335 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba5bc3-fbc0-4407-b52f-df142f1cae8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:57.546040 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-deba5bc3-fbc0-4407-b52f-df142f1cae8b None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:57.547638 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-deba5bc3-fbc0-4407-b52f-df142f1cae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:57.563473 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:57.580360 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88898309-ed84-4ab5-be79-67058563632f None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:57.614189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:57.629236 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978c5b3-7424-4f2e-81aa-49eb7d30f06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:57.630140 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978c5b3-7424-4f2e-81aa-49eb7d30f06b None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:57.630706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978c5b3-7424-4f2e-81aa-49eb7d30f06b None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:57.631180 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978c5b3-7424-4f2e-81aa-49eb7d30f06b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:57.640480 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 229/459] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:57.643248 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba386c-6cb6-4710-a3d6-4c6df77a22f8 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:57.643536 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba386c-6cb6-4710-a3d6-4c6df77a22f8 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:57.643810 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba386c-6cb6-4710-a3d6-4c6df77a22f8 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:57.645260 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 230/460] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:57.647459 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978c5b3-7424-4f2e-81aa-49eb7d30f06b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:57.649231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978c5b3-7424-4f2e-81aa-49eb7d30f06b None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:57.650360 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14054cd-2b47-4449-a5f0-dc492122f296 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:57.650673 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14054cd-2b47-4449-a5f0-dc492122f296 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:57.650944 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14054cd-2b47-4449-a5f0-dc492122f296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:57.666946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-2978c5b3-7424-4f2e-81aa-49eb7d30f06b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:57.666946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:57.666946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:57.666946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:57.666946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:57.666946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:57.666946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:57.666946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:57.666946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:57.666946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:57.666946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:57.666946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:57.666946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:57.666946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:57.666946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:57.667864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:57.668701 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:57.668701 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:57.668701 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:57.668701 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:57.670994 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 231/461] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:57.671286 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-b14054cd-2b47-4449-a5f0-dc492122f296 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:57.672305 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978c5b3-7424-4f2e-81aa-49eb7d30f06b None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:57.672497 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-b14054cd-2b47-4449-a5f0-dc492122f296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:57.748938 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 231/462] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:57.749884 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14054cd-2b47-4449-a5f0-dc492122f296 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:57.784728 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978c5b3-7424-4f2e-81aa-49eb7d30f06b None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:57.825930 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5d6f2-3869-479a-ab14-634fee07d530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:57.827018 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d6f2-3869-479a-ab14-634fee07d530 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:57.827495 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d6f2-3869-479a-ab14-634fee07d530 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:57.828049 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d6f2-3869-479a-ab14-634fee07d530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:57.839911 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5d6f2-3869-479a-ab14-634fee07d530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:57.841053 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:57.842710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5d6f2-3869-479a-ab14-634fee07d530 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:57.859984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-46b5d6f2-3869-479a-ab14-634fee07d530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:57.859984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:57.859984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:57.859984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:57.859984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:57.859984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:57.859984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:57.859984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:57.859984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:57.859984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:57.859984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:57.859984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:57.859984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:57.859984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:57.859984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:57.860905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:57.861750 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:57.861750 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:57.861750 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:57.861750 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:57.863972 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 232/463] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:57.864465 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14054cd-2b47-4449-a5f0-dc492122f296 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:57.865272 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5d6f2-3869-479a-ab14-634fee07d530 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:57.894976 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:57.904460 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafe242-771f-4d31-b305-a53505f5cfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:57.905295 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafe242-771f-4d31-b305-a53505f5cfdd None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:57.905716 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafe242-771f-4d31-b305-a53505f5cfdd None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:57.906127 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafe242-771f-4d31-b305-a53505f5cfdd None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:57.907010 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafe242-771f-4d31-b305-a53505f5cfdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:57.907478 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafe242-771f-4d31-b305-a53505f5cfdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:57.908993 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafe242-771f-4d31-b305-a53505f5cfdd None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:57.922092 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 232/464] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:57.923149 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafe242-771f-4d31-b305-a53505f5cfdd None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:57.974052 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5d6f2-3869-479a-ab14-634fee07d530 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:58.008417 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fc41b-5721-496b-aba1-6ae907f42f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:58.009066 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc41b-5721-496b-aba1-6ae907f42f67 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:58.009345 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc41b-5721-496b-aba1-6ae907f42f67 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:58.009612 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc41b-5721-496b-aba1-6ae907f42f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:58.021314 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fc41b-5721-496b-aba1-6ae907f42f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:58.022865 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fc41b-5721-496b-aba1-6ae907f42f67 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:58.028923 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafe242-771f-4d31-b305-a53505f5cfdd None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:58.038591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-0e1fc41b-5721-496b-aba1-6ae907f42f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:58.038591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:58.038591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:58.038591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:58.038591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:58.038591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:58.038591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:58.038591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:58.038591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:58.038591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:58.038591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:58.038591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:58.038591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:58.038591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:58.038591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:58.039433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:58.040250 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:58.040250 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:58.040250 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:58.040250 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:58.040250 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 233/465] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:58.040903 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fc41b-5721-496b-aba1-6ae907f42f67 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:58.065955 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448394bb-1c38-4b6e-a530-983ae351b80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:58.066611 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448394bb-1c38-4b6e-a530-983ae351b80a None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:58.066888 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448394bb-1c38-4b6e-a530-983ae351b80a None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:58.067221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448394bb-1c38-4b6e-a530-983ae351b80a None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:58.067854 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448394bb-1c38-4b6e-a530-983ae351b80a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:58.068214 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448394bb-1c38-4b6e-a530-983ae351b80a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:58.069591 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448394bb-1c38-4b6e-a530-983ae351b80a None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:58.083518 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:58.089727 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 233/466] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:58.091193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930bd5d-b7f7-4b87-b3d0-8f3a82982a5f None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:58.091423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930bd5d-b7f7-4b87-b3d0-8f3a82982a5f None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:58.091698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930bd5d-b7f7-4b87-b3d0-8f3a82982a5f None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:58.092877 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 234/467] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:58.093738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930bd5d-b7f7-4b87-b3d0-8f3a82982a5f None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:58.127253 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:58.149725 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fc41b-5721-496b-aba1-6ae907f42f67 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:58.186386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f75150-d24a-4bc6-adef-1e195fcca866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:58.187361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f75150-d24a-4bc6-adef-1e195fcca866 None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:58.187640 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f75150-d24a-4bc6-adef-1e195fcca866 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:58.187912 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f75150-d24a-4bc6-adef-1e195fcca866 None admin] PATH_INFO: `/v3/users` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:58.188608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f75150-d24a-4bc6-adef-1e195fcca866 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:58.190114 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f75150-d24a-4bc6-adef-1e195fcca866 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:58.206787 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930bd5d-b7f7-4b87-b3d0-8f3a82982a5f None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:58.216530 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 234/468] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Jul 26 10:13:58 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:58.217359 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f75150-d24a-4bc6-adef-1e195fcca866 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:58.264364 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c128f-dbdc-4f90-bc8b-3db16aa28411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:58.265011 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c128f-dbdc-4f90-bc8b-3db16aa28411 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:58.265290 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c128f-dbdc-4f90-bc8b-3db16aa28411 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:58.265565 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c128f-dbdc-4f90-bc8b-3db16aa28411 None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:58.266825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c128f-dbdc-4f90-bc8b-3db16aa28411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:58.267136 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c128f-dbdc-4f90-bc8b-3db16aa28411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:58.268925 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c128f-dbdc-4f90-bc8b-3db16aa28411 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:58.287368 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 235/469] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:58.287368 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dece15-73d4-4afb-8de0-d967aad6b91b None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:58.287368 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dece15-73d4-4afb-8de0-d967aad6b91b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:58.287368 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dece15-73d4-4afb-8de0-d967aad6b91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:58.305581 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-78dece15-73d4-4afb-8de0-d967aad6b91b None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:58.306886 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-78dece15-73d4-4afb-8de0-d967aad6b91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:58.339751 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f75150-d24a-4bc6-adef-1e195fcca866 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:58.374819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:58.385484 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994a185-52a4-4faa-9d73-4335bb121ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:58.386137 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994a185-52a4-4faa-9d73-4335bb121ca2 None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:58.386525 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994a185-52a4-4faa-9d73-4335bb121ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:58.386768 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994a185-52a4-4faa-9d73-4335bb121ca2 None admin] PATH_INFO: `/v3/users` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:58.387411 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994a185-52a4-4faa-9d73-4335bb121ca2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:58.389059 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994a185-52a4-4faa-9d73-4335bb121ca2 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:58.397153 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 236/470] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:58.397153 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dece15-73d4-4afb-8de0-d967aad6b91b None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:58.407195 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:58.422408 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 235/471] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Jul 26 10:13:58 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:58.423541 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994a185-52a4-4faa-9d73-4335bb121ca2 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:58.540934 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dece15-73d4-4afb-8de0-d967aad6b91b None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:58.561130 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994a185-52a4-4faa-9d73-4335bb121ca2 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:58.587838 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39dbd4-30ae-4af6-b844-c54e5d06230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:58.589202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39dbd4-30ae-4af6-b844-c54e5d06230e None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:58.589704 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39dbd4-30ae-4af6-b844-c54e5d06230e None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:58.590148 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39dbd4-30ae-4af6-b844-c54e5d06230e None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:58.591978 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39dbd4-30ae-4af6-b844-c54e5d06230e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:58.593745 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39dbd4-30ae-4af6-b844-c54e5d06230e None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:58.604565 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa904-399e-44df-87fb-7bca1739b513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:58.605333 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa904-399e-44df-87fb-7bca1739b513 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:58.605611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa904-399e-44df-87fb-7bca1739b513 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:58.605880 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa904-399e-44df-87fb-7bca1739b513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:58.621315 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273aa904-399e-44df-87fb-7bca1739b513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:58.622909 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273aa904-399e-44df-87fb-7bca1739b513 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:58.626395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 237/472] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Jul 26 10:13:58 2022] POST /identity/v3/users => generated 248 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:58.648163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-273aa904-399e-44df-87fb-7bca1739b513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:58.648163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:58.648163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:58.648163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:58.648163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:58.648163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:58.648163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:58.648163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:58.648163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:58.648163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:58.648163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:58.648163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:58.648163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:58.648163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:58.648163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:58.649090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:58.649935 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:58.649935 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:58.649935 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:58.649935 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:13:58.649935 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 236/473] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:58.655803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39dbd4-30ae-4af6-b844-c54e5d06230e None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:58.708152 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:58.778478 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39dbd4-30ae-4af6-b844-c54e5d06230e None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:58.818681 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd69275-dcd2-431a-bf88-a1ab54834e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:58.819326 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd69275-dcd2-431a-bf88-a1ab54834e22 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:58.819602 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd69275-dcd2-431a-bf88-a1ab54834e22 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:58.819866 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd69275-dcd2-431a-bf88-a1ab54834e22 None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:58.820583 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd69275-dcd2-431a-bf88-a1ab54834e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:58.820882 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd69275-dcd2-431a-bf88-a1ab54834e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:58.822268 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd69275-dcd2-431a-bf88-a1ab54834e22 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:58.838119 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 238/474] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:58.844367 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa904-399e-44df-87fb-7bca1739b513 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:58.897983 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:58.964187 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa904-399e-44df-87fb-7bca1739b513 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:59.004731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f71f4-fcc1-4f8d-9aab-8b4f2457d258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:59.005769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f71f4-fcc1-4f8d-9aab-8b4f2457d258 None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:59.006238 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f71f4-fcc1-4f8d-9aab-8b4f2457d258 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:59.006738 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f71f4-fcc1-4f8d-9aab-8b4f2457d258 None admin] PATH_INFO: `/v3/users` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:59.007436 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f71f4-fcc1-4f8d-9aab-8b4f2457d258 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:59.008882 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f71f4-fcc1-4f8d-9aab-8b4f2457d258 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:59.032578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 237/475] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Jul 26 10:13:58 2022] POST /identity/v3/users => generated 249 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:14:00.652742 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df637f3-ba0b-4966-a1c7-7f1364a0522d None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:00.653351 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df637f3-ba0b-4966-a1c7-7f1364a0522d None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:00.653351 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df637f3-ba0b-4966-a1c7-7f1364a0522d None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:00.654722 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 239/476] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:00.659997 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36a895-9bfe-4f53-8c3f-d2b7647de457 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:00.660415 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36a895-9bfe-4f53-8c3f-d2b7647de457 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:00.660588 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36a895-9bfe-4f53-8c3f-d2b7647de457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:00.679729 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-ea36a895-9bfe-4f53-8c3f-d2b7647de457 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:00.681072 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-ea36a895-9bfe-4f53-8c3f-d2b7647de457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:00.756340 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 238/477] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:14:00.780372 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df637f3-ba0b-4966-a1c7-7f1364a0522d None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:00.889133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df637f3-ba0b-4966-a1c7-7f1364a0522d None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:00.891956 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:00.925976 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8619a-3ad0-4f64-98a1-6fe77b0ca0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:00.926939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8619a-3ad0-4f64-98a1-6fe77b0ca0db None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:00.927383 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8619a-3ad0-4f64-98a1-6fe77b0ca0db None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:00.927815 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8619a-3ad0-4f64-98a1-6fe77b0ca0db None admin] PATH_INFO: `/v3/roles/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:00.932247 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388a40e-66e3-4a12-bdfe-d06bc16cb55a None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:00.932532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388a40e-66e3-4a12-bdfe-d06bc16cb55a None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:00.932808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388a40e-66e3-4a12-bdfe-d06bc16cb55a None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:00.934356 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 239/478] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:14:00.940052 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8528e-dacf-48eb-b1ac-2512fa2c72f6 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:00.940338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8528e-dacf-48eb-b1ac-2512fa2c72f6 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:00.940605 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8528e-dacf-48eb-b1ac-2512fa2c72f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:00.945963 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8619a-3ad0-4f64-98a1-6fe77b0ca0db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-d1c8619a-3ad0-4f64-98a1-6fe77b0ca0db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:00.952670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:00.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:00.954371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:00.954371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:00.954371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:00.954371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:00.954371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:00.954371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:00.954371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:00.954371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:00.954371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:00.954371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:00.954371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:00.954371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:00.962602 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 240/479] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:14:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:00.966373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8619a-3ad0-4f64-98a1-6fe77b0ca0db None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:00.967710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-c1a8528e-dacf-48eb-b1ac-2512fa2c72f6 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:00.969119 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-c1a8528e-dacf-48eb-b1ac-2512fa2c72f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:00.998940 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:01.057791 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 240/480] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:14:01.067848 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee67a24-ba7e-4b6d-a2fe-f41414e57185 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.068134 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee67a24-ba7e-4b6d-a2fe-f41414e57185 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.068415 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee67a24-ba7e-4b6d-a2fe-f41414e57185 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.069710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 241/481] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:01.079659 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8619a-3ad0-4f64-98a1-6fe77b0ca0db None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:01.086625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee67a24-ba7e-4b6d-a2fe-f41414e57185 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:01.117975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c7c9e-35b9-4006-bd1c-d66b4d7ba5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:01.118635 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c7c9e-35b9-4006-bd1c-d66b4d7ba5d6 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.118915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c7c9e-35b9-4006-bd1c-d66b4d7ba5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.119188 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c7c9e-35b9-4006-bd1c-d66b4d7ba5d6 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.119917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c7c9e-35b9-4006-bd1c-d66b4d7ba5d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:01.120223 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c7c9e-35b9-4006-bd1c-d66b4d7ba5d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:01.121602 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c7c9e-35b9-4006-bd1c-d66b4d7ba5d6 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:01.130219 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 241/482] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Jul 26 10:14:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:01.131543 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950c5b2-d41e-4504-9f91-c76517f69db4 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.131828 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950c5b2-d41e-4504-9f91-c76517f69db4 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.132103 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950c5b2-d41e-4504-9f91-c76517f69db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.152195 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-f950c5b2-d41e-4504-9f91-c76517f69db4 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:01.153490 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-f950c5b2-d41e-4504-9f91-c76517f69db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:01.174918 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:01.208999 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee67a24-ba7e-4b6d-a2fe-f41414e57185 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:01.221645 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 242/483] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:14:01.222557 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950c5b2-d41e-4504-9f91-c76517f69db4 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:01.255798 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c3e12-2c14-47ae-800d-acf0a5786531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:01.256852 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c3e12-2c14-47ae-800d-acf0a5786531 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.257337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c3e12-2c14-47ae-800d-acf0a5786531 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.257672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c3e12-2c14-47ae-800d-acf0a5786531 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.269154 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c3e12-2c14-47ae-800d-acf0a5786531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-ed1c3e12-2c14-47ae-800d-acf0a5786531 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:01.274472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:01.275379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:01.276277 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:01.276277 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:01.276277 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:01.276277 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:01.276277 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:01.276277 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:01.276277 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:01.276277 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:01.276277 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:01.276277 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:01.276277 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:01.276277 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:01.276277 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 242/484] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:14:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:01.276949 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c3e12-2c14-47ae-800d-acf0a5786531 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:01.298733 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:01.339424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950c5b2-d41e-4504-9f91-c76517f69db4 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:01.373190 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a39cf-7149-44a2-95f0-310a6adae6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:01.373842 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a39cf-7149-44a2-95f0-310a6adae6fc None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.374119 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a39cf-7149-44a2-95f0-310a6adae6fc None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.374389 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a39cf-7149-44a2-95f0-310a6adae6fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.384603 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a39cf-7149-44a2-95f0-310a6adae6fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:01.386074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a39cf-7149-44a2-95f0-310a6adae6fc None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:01.389391 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c3e12-2c14-47ae-800d-acf0a5786531 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:01.401209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-de2a39cf-7149-44a2-95f0-310a6adae6fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:01.401209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:01.401209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:01.401209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:01.401209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:01.401209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:01.401209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:01.401209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:01.401209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:01.401209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:01.401209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:01.401209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:01.401209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:01.401209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:01.401209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:01.402095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:01.403021 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:01.403021 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:01.403021 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:01.403021 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:01.403021 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 243/485] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:01.403294 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a39cf-7149-44a2-95f0-310a6adae6fc None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:01.418657 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:01.433565 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00139b6-b8fc-4680-a0a8-4fdd96eb98d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:01.434268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00139b6-b8fc-4680-a0a8-4fdd96eb98d1 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.434626 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00139b6-b8fc-4680-a0a8-4fdd96eb98d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.434899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00139b6-b8fc-4680-a0a8-4fdd96eb98d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.445977 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00139b6-b8fc-4680-a0a8-4fdd96eb98d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-c00139b6-b8fc-4680-a0a8-4fdd96eb98d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:01.451091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:01.452080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:01.452896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:01.452896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:01.452896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:01.452896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:01.452896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:01.452896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:01.452896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:01.452896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:01.452896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:01.452896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:01.452896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:01.452896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:01.452896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 243/486] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:14:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:01.453552 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00139b6-b8fc-4680-a0a8-4fdd96eb98d1 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:01.513589 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a39cf-7149-44a2-95f0-310a6adae6fc None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:01.529586 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:01.546403 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f0308-fb87-4832-aaff-331d120426bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:01.547096 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f0308-fb87-4832-aaff-331d120426bb None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.547362 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f0308-fb87-4832-aaff-331d120426bb None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.547627 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f0308-fb87-4832-aaff-331d120426bb None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.548322 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f0308-fb87-4832-aaff-331d120426bb None admin] RBAC: Adding query filter params (name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:01.548655 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f0308-fb87-4832-aaff-331d120426bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:01.550022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f0308-fb87-4832-aaff-331d120426bb None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:01.552337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00139b6-b8fc-4680-a0a8-4fdd96eb98d1 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:01.557943 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 244/487] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Jul 26 10:14:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:01.559209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd807c6c-0024-40dd-95fd-82b71a6117d7 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.559497 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd807c6c-0024-40dd-95fd-82b71a6117d7 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.559761 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd807c6c-0024-40dd-95fd-82b71a6117d7 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.560985 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 245/488] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:01.561666 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd807c6c-0024-40dd-95fd-82b71a6117d7 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:01.594006 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8880d7-9b71-4466-ad3d-fc1b9d6584ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:01.594666 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8880d7-9b71-4466-ad3d-fc1b9d6584ff None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.594936 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8880d7-9b71-4466-ad3d-fc1b9d6584ff None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.595201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8880d7-9b71-4466-ad3d-fc1b9d6584ff None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.595900 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8880d7-9b71-4466-ad3d-fc1b9d6584ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:01.596194 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8880d7-9b71-4466-ad3d-fc1b9d6584ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:01.597582 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8880d7-9b71-4466-ad3d-fc1b9d6584ff None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:01.620296 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 244/489] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:01.620296 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8880d7-9b71-4466-ad3d-fc1b9d6584ff None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:01.646547 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:01.684579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd807c6c-0024-40dd-95fd-82b71a6117d7 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:01.717916 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2c96c-de4b-4647-99cd-8dc154683e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:01.718555 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2c96c-de4b-4647-99cd-8dc154683e76 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.718829 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2c96c-de4b-4647-99cd-8dc154683e76 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.719117 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2c96c-de4b-4647-99cd-8dc154683e76 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.719791 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2c96c-de4b-4647-99cd-8dc154683e76 None admin] RBAC: Adding query filter params (name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:01.720083 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2c96c-de4b-4647-99cd-8dc154683e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:01.720769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8880d7-9b71-4466-ad3d-fc1b9d6584ff None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:01.721457 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2c96c-de4b-4647-99cd-8dc154683e76 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:01.730634 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 246/490] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Jul 26 10:14:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:01.732247 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50c704-334a-4220-8256-bc2e7664abda None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.732716 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50c704-334a-4220-8256-bc2e7664abda None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.733160 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50c704-334a-4220-8256-bc2e7664abda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.751950 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-bc50c704-334a-4220-8256-bc2e7664abda None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:01.753147 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-bc50c704-334a-4220-8256-bc2e7664abda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:01.754199 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e63c3-99a7-4ec6-bed5-c46112364c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:01.754870 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e63c3-99a7-4ec6-bed5-c46112364c45 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.755214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e63c3-99a7-4ec6-bed5-c46112364c45 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.755405 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e63c3-99a7-4ec6-bed5-c46112364c45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.761948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:01.766565 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e63c3-99a7-4ec6-bed5-c46112364c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:01.767972 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e63c3-99a7-4ec6-bed5-c46112364c45 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:01.782635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-2c7e63c3-99a7-4ec6-bed5-c46112364c45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:01.782635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:01.782635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:01.782635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:01.782635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:01.782635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:01.782635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:01.782635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:01.782635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:01.782635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:01.782635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:01.782635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:01.782635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:01.782635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:01.782635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:01.783585 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:01.784439 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:01.784439 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:01.784439 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:01.784439 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:01.784439 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 245/491] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:01.784709 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e63c3-99a7-4ec6-bed5-c46112364c45 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:01.830149 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 247/492] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:14:01.831315 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50c704-334a-4220-8256-bc2e7664abda None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:01.895505 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e63c3-99a7-4ec6-bed5-c46112364c45 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:01.899615 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:01.930216 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee96b9-e508-47e3-8ec2-ba5e11229ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:01.930879 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee96b9-e508-47e3-8ec2-ba5e11229ca7 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.931154 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee96b9-e508-47e3-8ec2-ba5e11229ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.931482 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee96b9-e508-47e3-8ec2-ba5e11229ca7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.938807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee96b9-e508-47e3-8ec2-ba5e11229ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:01.940193 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50c704-334a-4220-8256-bc2e7664abda None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:01.940327 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee96b9-e508-47e3-8ec2-ba5e11229ca7 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-bcee96b9-e508-47e3-8ec2-ba5e11229ca7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:01.953579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:01.955281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:01.956338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:01.956338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:01.956338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:01.956338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:01.956338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:01.956338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:01.956338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:01.956338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:01.956338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:14:01.956338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:01.956338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 246/493] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Jul 26 10:14:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:01.956338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee96b9-e508-47e3-8ec2-ba5e11229ca7 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:01.982475 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76d20f-1945-415b-9989-8095d2926f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:01.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76d20f-1945-415b-9989-8095d2926f55 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.983399 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76d20f-1945-415b-9989-8095d2926f55 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.983666 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76d20f-1945-415b-9989-8095d2926f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.994080 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76d20f-1945-415b-9989-8095d2926f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:01.995633 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76d20f-1945-415b-9989-8095d2926f55 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:02.008892 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:02.011184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-8b76d20f-1945-415b-9989-8095d2926f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:02.011184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:02.011184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:02.011184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:02.011184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:02.011184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:02.011184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:02.011184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:02.011184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:02.011184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:02.011184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:02.011184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:02.011184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:02.011184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:02.011184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:02.012086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:02.012972 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:02.012972 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:02.012972 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:02.012972 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:02.012972 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 248/494] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:02.013423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76d20f-1945-415b-9989-8095d2926f55 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:02.065341 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee96b9-e508-47e3-8ec2-ba5e11229ca7 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:02.099323 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8417f0a-8e6d-4829-9923-caf12ba0a60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:02.099949 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8417f0a-8e6d-4829-9923-caf12ba0a60a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:02.100227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8417f0a-8e6d-4829-9923-caf12ba0a60a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:02.100499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8417f0a-8e6d-4829-9923-caf12ba0a60a None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:02.101193 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8417f0a-8e6d-4829-9923-caf12ba0a60a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:02.101494 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8417f0a-8e6d-4829-9923-caf12ba0a60a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:02.102946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8417f0a-8e6d-4829-9923-caf12ba0a60a None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:02.113014 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76d20f-1945-415b-9989-8095d2926f55 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:02.114334 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 247/495] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:02.115179 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8417f0a-8e6d-4829-9923-caf12ba0a60a None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:02.127762 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:02.149734 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb085f0d-7a14-41c1-a6ce-da8205f1fba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:02.150392 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb085f0d-7a14-41c1-a6ce-da8205f1fba1 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:02.150704 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb085f0d-7a14-41c1-a6ce-da8205f1fba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:02.150974 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb085f0d-7a14-41c1-a6ce-da8205f1fba1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:02.161738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb085f0d-7a14-41c1-a6ce-da8205f1fba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-fb085f0d-7a14-41c1-a6ce-da8205f1fba1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:02.167562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:02.168448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:02.169400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:02.169400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:02.169400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:02.169400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:02.169400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:02.169400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:02.169400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:02.169400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:02.169400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:02.169400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:02.169400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:02.169400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:02.169400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 249/496] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:14:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:02.170061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb085f0d-7a14-41c1-a6ce-da8205f1fba1 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:02.221925 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8417f0a-8e6d-4829-9923-caf12ba0a60a None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:02.233069 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:02.257656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d746b1d-5a70-4fc2-933f-9bf6cc0cff03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:02.258279 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d746b1d-5a70-4fc2-933f-9bf6cc0cff03 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:02.258745 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d746b1d-5a70-4fc2-933f-9bf6cc0cff03 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:02.259022 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d746b1d-5a70-4fc2-933f-9bf6cc0cff03 None admin] PATH_INFO: `/v3/users` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:02.259833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d746b1d-5a70-4fc2-933f-9bf6cc0cff03 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:02.260141 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d746b1d-5a70-4fc2-933f-9bf6cc0cff03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:02.261684 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d746b1d-5a70-4fc2-933f-9bf6cc0cff03 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:02.271338 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb085f0d-7a14-41c1-a6ce-da8205f1fba1 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:02.303937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 248/497] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Jul 26 10:14:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:02.303937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d746b1d-5a70-4fc2-933f-9bf6cc0cff03 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:02.315578 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7a9f5-5fb0-4102-b55f-475bb4528022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:02.316204 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7a9f5-5fb0-4102-b55f-475bb4528022 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:02.316487 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7a9f5-5fb0-4102-b55f-475bb4528022 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:02.316766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7a9f5-5fb0-4102-b55f-475bb4528022 None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:02.317460 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7a9f5-5fb0-4102-b55f-475bb4528022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:02.317765 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7a9f5-5fb0-4102-b55f-475bb4528022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:02.319253 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7a9f5-5fb0-4102-b55f-475bb4528022 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:02.335848 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 250/498] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:02.335848 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7a9f5-5fb0-4102-b55f-475bb4528022 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:02.368281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:02.403886 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d746b1d-5a70-4fc2-933f-9bf6cc0cff03 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:02.439524 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266994e-4efc-4b64-8d6c-ee2a65545364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:02.439751 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7a9f5-5fb0-4102-b55f-475bb4528022 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:02.440170 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266994e-4efc-4b64-8d6c-ee2a65545364 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:02.440448 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266994e-4efc-4b64-8d6c-ee2a65545364 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:02.440714 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266994e-4efc-4b64-8d6c-ee2a65545364 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:02.448132 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266994e-4efc-4b64-8d6c-ee2a65545364 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:02.449605 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266994e-4efc-4b64-8d6c-ee2a65545364 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-8266994e-4efc-4b64-8d6c-ee2a65545364 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:02.461329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:02.462625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:02.463595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:02.463595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:02.463595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:02.463595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:02.463595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:02.463595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:02.463595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:02.463595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:02.463595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 10:14:02.463595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:02.463595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 249/499] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:02.464169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266994e-4efc-4b64-8d6c-ee2a65545364 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:02.480194 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04829e-1a38-4f3d-900a-c31c823ea3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:02.480830 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04829e-1a38-4f3d-900a-c31c823ea3e2 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:02.481192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04829e-1a38-4f3d-900a-c31c823ea3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:02.481450 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04829e-1a38-4f3d-900a-c31c823ea3e2 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:02.482195 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04829e-1a38-4f3d-900a-c31c823ea3e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:02.482506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04829e-1a38-4f3d-900a-c31c823ea3e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:02.483926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04829e-1a38-4f3d-900a-c31c823ea3e2 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:02.492117 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 251/500] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Jul 26 10:14:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:02.492932 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04829e-1a38-4f3d-900a-c31c823ea3e2 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:02.500424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:02.572346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266994e-4efc-4b64-8d6c-ee2a65545364 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:02.586064 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:02.594342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04829e-1a38-4f3d-900a-c31c823ea3e2 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:02.608100 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e3865-1207-4cbf-bfcc-2a94ad40bac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:02.608755 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e3865-1207-4cbf-bfcc-2a94ad40bac9 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:02.609018 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e3865-1207-4cbf-bfcc-2a94ad40bac9 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:02.609283 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e3865-1207-4cbf-bfcc-2a94ad40bac9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:02.628945 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf65a5-eb43-4e97-85f5-02137007837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:02.629599 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf65a5-eb43-4e97-85f5-02137007837c None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:02.629880 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf65a5-eb43-4e97-85f5-02137007837c None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:02.630152 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf65a5-eb43-4e97-85f5-02137007837c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:02.638305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf65a5-eb43-4e97-85f5-02137007837c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:02.639806 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf65a5-eb43-4e97-85f5-02137007837c None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-c1cf65a5-eb43-4e97-85f5-02137007837c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:02.652563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:02.653750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:02.655106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:02.655106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:02.655106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:02.655106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:02.655106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:02.655106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:02.655106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:02.655106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:02.655106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:14:02.655106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:02.655106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 252/501] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:02.655106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf65a5-eb43-4e97-85f5-02137007837c None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:02.683622 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e3865-1207-4cbf-bfcc-2a94ad40bac9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:02.685412 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e3865-1207-4cbf-bfcc-2a94ad40bac9 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:02.711885 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:02.758378 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf65a5-eb43-4e97-85f5-02137007837c None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:02.784381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 250/502] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:14:02.785320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e3865-1207-4cbf-bfcc-2a94ad40bac9 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:02.793310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036ea02-595d-494b-ba34-4d585e8d391c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:02.794163 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036ea02-595d-494b-ba34-4d585e8d391c None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:02.794463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036ea02-595d-494b-ba34-4d585e8d391c None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:02.794759 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036ea02-595d-494b-ba34-4d585e8d391c None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:02.795552 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036ea02-595d-494b-ba34-4d585e8d391c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:02.795861 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036ea02-595d-494b-ba34-4d585e8d391c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:02.797323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036ea02-595d-494b-ba34-4d585e8d391c None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:02.838854 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 253/503] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Jul 26 10:14:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:02.838854 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036ea02-595d-494b-ba34-4d585e8d391c None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:02.852637 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:02.886183 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e3865-1207-4cbf-bfcc-2a94ad40bac9 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:02.913520 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:02.921683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d316bd-094c-4ce1-9e34-b1a2ae7efbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:02.922324 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d316bd-094c-4ce1-9e34-b1a2ae7efbc0 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:02.922631 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d316bd-094c-4ce1-9e34-b1a2ae7efbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:02.922896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d316bd-094c-4ce1-9e34-b1a2ae7efbc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:02.933239 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d316bd-094c-4ce1-9e34-b1a2ae7efbc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:02.934745 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d316bd-094c-4ce1-9e34-b1a2ae7efbc0 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:02.936954 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036ea02-595d-494b-ba34-4d585e8d391c None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:02.950116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-f2d316bd-094c-4ce1-9e34-b1a2ae7efbc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:02.950116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:02.950116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:02.950116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:02.950116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:02.950116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:02.950116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:02.950116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:02.950116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:02.950116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:02.950116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:02.950116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:02.950116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:02.950116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:02.950116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:02.951203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:02.952066 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:02.952066 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:02.952066 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:02.952066 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:02.952066 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 251/504] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:02.952066 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d316bd-094c-4ce1-9e34-b1a2ae7efbc0 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:02.977575 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c79f1-c252-45dc-b597-8126d7081f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:02.978190 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c79f1-c252-45dc-b597-8126d7081f1d None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:02.978472 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c79f1-c252-45dc-b597-8126d7081f1d None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:02.978743 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c79f1-c252-45dc-b597-8126d7081f1d None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:02.979547 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c79f1-c252-45dc-b597-8126d7081f1d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:02.979850 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c79f1-c252-45dc-b597-8126d7081f1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:02.981350 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c79f1-c252-45dc-b597-8126d7081f1d None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:02.998751 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 254/505] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Jul 26 10:14:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:02.999587 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c79f1-c252-45dc-b597-8126d7081f1d None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:03.058624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d316bd-094c-4ce1-9e34-b1a2ae7efbc0 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:03.075664 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:03.092518 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf747aa-e7ab-474d-9979-31ac947e1cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:03.093089 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf747aa-e7ab-474d-9979-31ac947e1cbf None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:03.093369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf747aa-e7ab-474d-9979-31ac947e1cbf None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:03.093641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf747aa-e7ab-474d-9979-31ac947e1cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:03.104414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf747aa-e7ab-474d-9979-31ac947e1cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:03.105853 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c79f1-c252-45dc-b597-8126d7081f1d None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:03.105981 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf747aa-e7ab-474d-9979-31ac947e1cbf None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:03.120095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-bcf747aa-e7ab-474d-9979-31ac947e1cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:03.120095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:03.120095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:03.120095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:03.120095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:03.120095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:03.120095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:03.120095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:03.120095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:03.120095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:03.120095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:03.120095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:03.120095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:03.120095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:03.120095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:03.120967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:03.121872 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:03.121872 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:03.121872 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:03.121872 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:03.121872 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 252/506] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:03.122141 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf747aa-e7ab-474d-9979-31ac947e1cbf None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:03.144972 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4eefa-17ce-48e2-a22e-e130974eb46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:03.145599 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4eefa-17ce-48e2-a22e-e130974eb46e None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:03.145872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4eefa-17ce-48e2-a22e-e130974eb46e None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:03.146139 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4eefa-17ce-48e2-a22e-e130974eb46e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:03.155863 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:03.217003 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4eefa-17ce-48e2-a22e-e130974eb46e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:03.218483 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4eefa-17ce-48e2-a22e-e130974eb46e None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:03.225094 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf747aa-e7ab-474d-9979-31ac947e1cbf None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:03.258980 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e12c2-a658-419b-8b1d-8fd9ef986695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:03.259609 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e12c2-a658-419b-8b1d-8fd9ef986695 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:03.259885 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e12c2-a658-419b-8b1d-8fd9ef986695 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:03.260162 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e12c2-a658-419b-8b1d-8fd9ef986695 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:03.260943 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e12c2-a658-419b-8b1d-8fd9ef986695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:03.261248 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e12c2-a658-419b-8b1d-8fd9ef986695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:03.262712 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e12c2-a658-419b-8b1d-8fd9ef986695 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:03.274022 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 253/507] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:03.275133 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e12c2-a658-419b-8b1d-8fd9ef986695 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:03.285607 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:03.318676 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 255/508] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:14:03.319561 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4eefa-17ce-48e2-a22e-e130974eb46e None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:03.382519 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:03.391999 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e12c2-a658-419b-8b1d-8fd9ef986695 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:03.421813 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4eefa-17ce-48e2-a22e-e130974eb46e None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:03.428461 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f57c1-4647-40d8-8aa0-fe533e447132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:03.429134 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f57c1-4647-40d8-8aa0-fe533e447132 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:03.430076 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f57c1-4647-40d8-8aa0-fe533e447132 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:03.430076 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f57c1-4647-40d8-8aa0-fe533e447132 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:03.460234 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ead3-f0ad-4c8f-ad5b-5f1fb2e65625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:03.460929 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ead3-f0ad-4c8f-ad5b-5f1fb2e65625 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:03.461213 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ead3-f0ad-4c8f-ad5b-5f1fb2e65625 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:03.461497 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ead3-f0ad-4c8f-ad5b-5f1fb2e65625 None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:03.462198 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ead3-f0ad-4c8f-ad5b-5f1fb2e65625 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:03.462546 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ead3-f0ad-4c8f-ad5b-5f1fb2e65625 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:03.463927 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ead3-f0ad-4c8f-ad5b-5f1fb2e65625 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:03.475869 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 256/509] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:03.476727 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ead3-f0ad-4c8f-ad5b-5f1fb2e65625 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:03.502688 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f57c1-4647-40d8-8aa0-fe533e447132 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:03.504183 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f57c1-4647-40d8-8aa0-fe533e447132 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:03.513873 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:03.590688 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ead3-f0ad-4c8f-ad5b-5f1fb2e65625 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:03.601604 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:03.611809 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 254/510] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:14:03.612635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f57c1-4647-40d8-8aa0-fe533e447132 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:03.625437 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d49543-61f5-49ee-ada6-2807f5dbc011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:03.626090 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d49543-61f5-49ee-ada6-2807f5dbc011 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:03.626370 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d49543-61f5-49ee-ada6-2807f5dbc011 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:03.626673 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d49543-61f5-49ee-ada6-2807f5dbc011 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:03.634744 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d49543-61f5-49ee-ada6-2807f5dbc011 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:03.636181 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d49543-61f5-49ee-ada6-2807f5dbc011 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-f8d49543-61f5-49ee-ada6-2807f5dbc011 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:03.648137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:03.649156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:03.650059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:03.650059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:03.650059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:03.650059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:03.650059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:03.650059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:03.650059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:03.650059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:03.650059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 10:14:03.650059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:03.650059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 257/511] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:14:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:03.651171 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d49543-61f5-49ee-ada6-2807f5dbc011 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:03.726677 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f57c1-4647-40d8-8aa0-fe533e447132 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:03.758745 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:03.767384 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef300fae-a482-435f-ae4f-838c7d3bb111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:03.768035 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef300fae-a482-435f-ae4f-838c7d3bb111 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:03.768306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef300fae-a482-435f-ae4f-838c7d3bb111 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:03.768571 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef300fae-a482-435f-ae4f-838c7d3bb111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:03.768724 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d49543-61f5-49ee-ada6-2807f5dbc011 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:03.784622 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef300fae-a482-435f-ae4f-838c7d3bb111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:03.786142 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef300fae-a482-435f-ae4f-838c7d3bb111 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:03.806603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-ef300fae-a482-435f-ae4f-838c7d3bb111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:03.806603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:03.806603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:03.806603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:03.806603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:03.806603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:03.806603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:03.806603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:03.806603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:03.806603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:03.806603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:03.806603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:03.806603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:03.806603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:03.806603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:03.807608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:03.808697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:03.808697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:03.808697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:03.808697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:03.808697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 255/512] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:03.808697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef300fae-a482-435f-ae4f-838c7d3bb111 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:03.813412 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61599c16-0a7e-4c0d-976d-82c6bb993ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:03.814080 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61599c16-0a7e-4c0d-976d-82c6bb993ccd None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:03.814377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61599c16-0a7e-4c0d-976d-82c6bb993ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:03.814671 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61599c16-0a7e-4c0d-976d-82c6bb993ccd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:03.821935 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61599c16-0a7e-4c0d-976d-82c6bb993ccd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:03.823444 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61599c16-0a7e-4c0d-976d-82c6bb993ccd None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:03.836007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-61599c16-0a7e-4c0d-976d-82c6bb993ccd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:03.836007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:03.836007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:03.836007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:03.836007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:03.836007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:03.836007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:03.836007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:03.836007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:03.836007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:03.836007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:03.836007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:03.836007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:03.836007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:03.836007 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:03.837192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:03.838146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:03.838146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:03.838146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:03.838146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:03.838146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:03.838146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:03.838146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:03.838146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:03.838146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 258/513] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:03.838146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61599c16-0a7e-4c0d-976d-82c6bb993ccd None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:03.861087 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:03.915278 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef300fae-a482-435f-ae4f-838c7d3bb111 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:03.945309 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61599c16-0a7e-4c0d-976d-82c6bb993ccd None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:03.950631 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206998ab-f416-4a6d-babc-b74b2072f149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:03.951283 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206998ab-f416-4a6d-babc-b74b2072f149 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:03.951561 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206998ab-f416-4a6d-babc-b74b2072f149 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:03.951830 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206998ab-f416-4a6d-babc-b74b2072f149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:03.962524 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206998ab-f416-4a6d-babc-b74b2072f149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:03.964008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206998ab-f416-4a6d-babc-b74b2072f149 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:03.978589 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccd429-6753-462e-838b-255d1ce30ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:03.978764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-206998ab-f416-4a6d-babc-b74b2072f149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:03.978764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:03.978764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:03.978764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:03.978764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:03.978764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:03.978764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:03.978764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:03.978764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:03.978764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:03.978764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:03.978764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:03.978764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:03.978764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:03.978764 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:03.979742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:03.980611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:03.980611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:03.980611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:03.980611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:03.980860 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccd429-6753-462e-838b-255d1ce30ccd None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:03.980860 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccd429-6753-462e-838b-255d1ce30ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:03.980860 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccd429-6753-462e-838b-255d1ce30ccd None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:03.980860 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccd429-6753-462e-838b-255d1ce30ccd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:03.980860 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccd429-6753-462e-838b-255d1ce30ccd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:03.981503 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 256/514] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:03.982264 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccd429-6753-462e-838b-255d1ce30ccd None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:03.982498 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206998ab-f416-4a6d-babc-b74b2072f149 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:03.999424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 259/515] 10.222.0.60 () {56 vars in 1139 bytes} [Tue Jul 26 10:14:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:04.000250 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccd429-6753-462e-838b-255d1ce30ccd None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:04.014400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:04.082837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:04.090097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206998ab-f416-4a6d-babc-b74b2072f149 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:04.112772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccd429-6753-462e-838b-255d1ce30ccd None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:04.124936 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481ab36-d72e-45bb-85cb-78fe068668c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:04.125558 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481ab36-d72e-45bb-85cb-78fe068668c1 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:04.125836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481ab36-d72e-45bb-85cb-78fe068668c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:04.126108 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481ab36-d72e-45bb-85cb-78fe068668c1 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:04.126849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481ab36-d72e-45bb-85cb-78fe068668c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:04.127154 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481ab36-d72e-45bb-85cb-78fe068668c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:04.128674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481ab36-d72e-45bb-85cb-78fe068668c1 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:04.141160 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 257/516] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:04.142009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481ab36-d72e-45bb-85cb-78fe068668c1 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:04.152374 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398319ef-e8d9-4f0c-b30b-0950a8d76fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:04.153085 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398319ef-e8d9-4f0c-b30b-0950a8d76fc6 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:04.153369 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398319ef-e8d9-4f0c-b30b-0950a8d76fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:04.153693 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398319ef-e8d9-4f0c-b30b-0950a8d76fc6 None admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:04.154813 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398319ef-e8d9-4f0c-b30b-0950a8d76fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:04.155126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398319ef-e8d9-4f0c-b30b-0950a8d76fc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:04.156634 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398319ef-e8d9-4f0c-b30b-0950a8d76fc6 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:04.175770 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 260/517] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:14:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:04.176534 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398319ef-e8d9-4f0c-b30b-0950a8d76fc6 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:04.243044 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481ab36-d72e-45bb-85cb-78fe068668c1 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:04.248300 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:04.278466 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831a64a-697e-427d-a4f2-c584792feb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:04.279111 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831a64a-697e-427d-a4f2-c584792feb00 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:04.279395 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831a64a-697e-427d-a4f2-c584792feb00 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:04.279670 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831a64a-697e-427d-a4f2-c584792feb00 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:04.280250 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398319ef-e8d9-4f0c-b30b-0950a8d76fc6 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:04.280352 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831a64a-697e-427d-a4f2-c584792feb00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:04.280651 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831a64a-697e-427d-a4f2-c584792feb00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:04.282026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831a64a-697e-427d-a4f2-c584792feb00 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:04.294280 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 258/518] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:04.295139 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831a64a-697e-427d-a4f2-c584792feb00 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:04.314342 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:04.315116 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e419442-ea50-4018-bf57-9bc03e013d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:04.315818 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e419442-ea50-4018-bf57-9bc03e013d14 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:04.316146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e419442-ea50-4018-bf57-9bc03e013d14 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:04.316452 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e419442-ea50-4018-bf57-9bc03e013d14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:04.390118 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e419442-ea50-4018-bf57-9bc03e013d14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:04.391635 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e419442-ea50-4018-bf57-9bc03e013d14 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:04.399070 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831a64a-697e-427d-a4f2-c584792feb00 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:04.433574 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefcb66-58ca-4a46-be90-8baf6d0c01ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:04.434127 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefcb66-58ca-4a46-be90-8baf6d0c01ee None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:04.434658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefcb66-58ca-4a46-be90-8baf6d0c01ee None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:04.434658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefcb66-58ca-4a46-be90-8baf6d0c01ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:04.441411 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefcb66-58ca-4a46-be90-8baf6d0c01ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:04.442900 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefcb66-58ca-4a46-be90-8baf6d0c01ee None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:04.454966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-eeefcb66-58ca-4a46-be90-8baf6d0c01ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:04.454966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:04.454966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:04.454966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:04.454966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:04.454966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:04.454966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:04.454966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:04.454966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:04.454966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:04.454966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:04.454966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:04.454966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:04.454966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:04.454966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:04.455850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:04.456692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:04.456692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:04.456692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:04.456692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:04.456692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:04.456692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:04.456692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:04.456692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:04.456692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 259/519] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:04.457163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefcb66-58ca-4a46-be90-8baf6d0c01ee None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:04.462758 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:04.494515 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 261/520] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:14:04.495378 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e419442-ea50-4018-bf57-9bc03e013d14 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:04.533797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:04.558576 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefcb66-58ca-4a46-be90-8baf6d0c01ee None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:04.596771 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dba32a-92f1-40a6-810e-9d5bc98f3611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:04.597419 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e419442-ea50-4018-bf57-9bc03e013d14 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:04.597735 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dba32a-92f1-40a6-810e-9d5bc98f3611 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:04.598163 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dba32a-92f1-40a6-810e-9d5bc98f3611 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:04.598644 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dba32a-92f1-40a6-810e-9d5bc98f3611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:04.599962 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dba32a-92f1-40a6-810e-9d5bc98f3611 None admin] RBAC: Adding query filter params (role.id=81782254e8c2428284b8181e87647f8a, scope.project.id=6897068dc29445f7878c7c12a0915d48, user.id=d68b323bc2b54984ad2ed0d248675624) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:04.600461 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dba32a-92f1-40a6-810e-9d5bc98f3611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:04.602587 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dba32a-92f1-40a6-810e-9d5bc98f3611 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:04.614477 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 260/521] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:14:04 2022] GET /identity/v3/role_assignments?user.id=d68b323bc2b54984ad2ed0d248675624&scope.project.id=6897068dc29445f7878c7c12a0915d48&role.id=81782254e8c2428284b8181e87647f8a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:04.614477 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dba32a-92f1-40a6-810e-9d5bc98f3611 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:04.644396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed04f22-19ca-4044-8481-962ecbb37de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:04.645077 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed04f22-19ca-4044-8481-962ecbb37de1 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:04.645448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed04f22-19ca-4044-8481-962ecbb37de1 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:04.645742 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed04f22-19ca-4044-8481-962ecbb37de1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:04.654180 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed04f22-19ca-4044-8481-962ecbb37de1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:04.655781 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed04f22-19ca-4044-8481-962ecbb37de1 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:04.671143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-0ed04f22-19ca-4044-8481-962ecbb37de1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:04.671143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:04.671143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:04.671143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:04.671143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:04.671143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:04.671143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:04.671143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:04.671143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:04.671143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:04.671143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:04.671143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:04.671143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:04.671143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:04.671143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:04.672098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:04.672948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:04.672948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:04.672948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:04.672948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:04.672948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:04.672948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:04.672948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:04.672948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:04.672948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 262/522] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:04.673403 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed04f22-19ca-4044-8481-962ecbb37de1 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:04.709479 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:04.750306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dba32a-92f1-40a6-810e-9d5bc98f3611 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:04.788420 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaf562-2d35-45e8-8bec-ccf93767bcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:04.789114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed04f22-19ca-4044-8481-962ecbb37de1 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:04.789469 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf562-2d35-45e8-8bec-ccf93767bcd5 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:04.789469 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf562-2d35-45e8-8bec-ccf93767bcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:04.789627 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf562-2d35-45e8-8bec-ccf93767bcd5 None admin] PATH_INFO: `/v3/projects` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:04.790313 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaf562-2d35-45e8-8bec-ccf93767bcd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:04.790661 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaf562-2d35-45e8-8bec-ccf93767bcd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:04.792120 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaf562-2d35-45e8-8bec-ccf93767bcd5 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:04.808791 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:04.818979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 261/523] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:14:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:04.820001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaf562-2d35-45e8-8bec-ccf93767bcd5 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:04.833199 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c1fff-8de3-409f-90bd-ccd41cee47cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:04.833939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c1fff-8de3-409f-90bd-ccd41cee47cb None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:04.834221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c1fff-8de3-409f-90bd-ccd41cee47cb None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:04.834517 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c1fff-8de3-409f-90bd-ccd41cee47cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:04.847879 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c1fff-8de3-409f-90bd-ccd41cee47cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:04.849360 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c1fff-8de3-409f-90bd-ccd41cee47cb None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:04.866301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-c91c1fff-8de3-409f-90bd-ccd41cee47cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:04.866301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:04.866301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:04.866301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:04.866301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:04.866301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:04.866301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:04.866301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:04.866301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:04.866301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:04.866301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:04.866301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:04.866301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:04.866301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:04.866301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:04.867443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:04.868424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:04.868424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:04.868424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:04.868424 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:04.870631 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 263/524] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:04.871538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c1fff-8de3-409f-90bd-ccd41cee47cb None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:04.934041 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaf562-2d35-45e8-8bec-ccf93767bcd5 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:04.963629 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:04.972497 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25208c9d-232f-4773-9167-4a315cca7175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:04.973129 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25208c9d-232f-4773-9167-4a315cca7175 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:04.973396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25208c9d-232f-4773-9167-4a315cca7175 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:04.973680 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25208c9d-232f-4773-9167-4a315cca7175 None admin] PATH_INFO: `/v3/projects` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:04.974459 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25208c9d-232f-4773-9167-4a315cca7175 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:04.974758 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25208c9d-232f-4773-9167-4a315cca7175 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:04.976238 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25208c9d-232f-4773-9167-4a315cca7175 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:04.984735 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c1fff-8de3-409f-90bd-ccd41cee47cb None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:04.993914 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 262/525] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:14:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:04.993914 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25208c9d-232f-4773-9167-4a315cca7175 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:05.032103 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e926f-a91f-473a-a080-1d399733af53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:05.032736 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e926f-a91f-473a-a080-1d399733af53 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:05.033024 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e926f-a91f-473a-a080-1d399733af53 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:05.033295 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e926f-a91f-473a-a080-1d399733af53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:05.034109 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e926f-a91f-473a-a080-1d399733af53 None admin] RBAC: Adding query filter params (role.id=81782254e8c2428284b8181e87647f8a, scope.project.id=6897068dc29445f7878c7c12a0915d48, user.id=7f4adbb70e9f46f9a6a416329e8c0bf2) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:05.034419 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e926f-a91f-473a-a080-1d399733af53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:05.035893 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e926f-a91f-473a-a080-1d399733af53 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:05.046506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 264/526] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:14:04 2022] GET /identity/v3/role_assignments?user.id=7f4adbb70e9f46f9a6a416329e8c0bf2&scope.project.id=6897068dc29445f7878c7c12a0915d48&role.id=81782254e8c2428284b8181e87647f8a => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:05.046506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e926f-a91f-473a-a080-1d399733af53 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:05.081524 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:05.137295 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25208c9d-232f-4773-9167-4a315cca7175 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:05.177437 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e926f-a91f-473a-a080-1d399733af53 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:05.183877 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d01a2-953b-446a-98bf-8f28da00c5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:05.184582 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d01a2-953b-446a-98bf-8f28da00c5f3 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:05.184860 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d01a2-953b-446a-98bf-8f28da00c5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:05.185132 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d01a2-953b-446a-98bf-8f28da00c5f3 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:05.185873 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d01a2-953b-446a-98bf-8f28da00c5f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:05.186861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d01a2-953b-446a-98bf-8f28da00c5f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:05.188312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d01a2-953b-446a-98bf-8f28da00c5f3 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:05.205874 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 263/527] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:05.212934 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d01a2-953b-446a-98bf-8f28da00c5f3 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:05.225461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51955ac9-b5bb-4e62-b80b-df9c031dac36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:05.226000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51955ac9-b5bb-4e62-b80b-df9c031dac36 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:05.226331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51955ac9-b5bb-4e62-b80b-df9c031dac36 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:05.226657 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51955ac9-b5bb-4e62-b80b-df9c031dac36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:05.227491 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51955ac9-b5bb-4e62-b80b-df9c031dac36 None admin] RBAC: Adding query filter params (role.id=81782254e8c2428284b8181e87647f8a, scope.project.id=6897068dc29445f7878c7c12a0915d48, user.id=6a2272bbc60f47fc929b1cc352533f7e) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:05.227805 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51955ac9-b5bb-4e62-b80b-df9c031dac36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:05.229273 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51955ac9-b5bb-4e62-b80b-df9c031dac36 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:05.242467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 265/528] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:14:05 2022] GET /identity/v3/role_assignments?user.id=6a2272bbc60f47fc929b1cc352533f7e&scope.project.id=6897068dc29445f7878c7c12a0915d48&role.id=81782254e8c2428284b8181e87647f8a => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:05.339750 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d01a2-953b-446a-98bf-8f28da00c5f3 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:05.362659 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:05.378001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c3512-bd04-49bd-8a0f-b747ed912d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:05.378703 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c3512-bd04-49bd-8a0f-b747ed912d57 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:05.378983 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c3512-bd04-49bd-8a0f-b747ed912d57 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:05.379255 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c3512-bd04-49bd-8a0f-b747ed912d57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:05.387466 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c3512-bd04-49bd-8a0f-b747ed912d57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:05.388969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c3512-bd04-49bd-8a0f-b747ed912d57 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:05.401969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-099c3512-bd04-49bd-8a0f-b747ed912d57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:05.401969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:05.401969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:05.401969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:05.401969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:05.401969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:05.401969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:05.401969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:05.401969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:05.401969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:05.401969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:05.401969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:05.401969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:05.401969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:05.401969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:05.402984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:05.404033 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:05.404033 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:05.404033 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:05.404033 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:05.404033 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:05.404033 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:05.404033 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:05.404033 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:05.404033 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 264/529] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:05.415664 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51955ac9-b5bb-4e62-b80b-df9c031dac36 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:05.433113 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:05.528818 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51955ac9-b5bb-4e62-b80b-df9c031dac36 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:05.563817 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8663dc-391d-40bc-8af3-e7ac5b544460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:05.564451 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8663dc-391d-40bc-8af3-e7ac5b544460 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:05.564729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8663dc-391d-40bc-8af3-e7ac5b544460 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:05.564998 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8663dc-391d-40bc-8af3-e7ac5b544460 None admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:05.565765 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8663dc-391d-40bc-8af3-e7ac5b544460 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:05.566070 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8663dc-391d-40bc-8af3-e7ac5b544460 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:05.567711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8663dc-391d-40bc-8af3-e7ac5b544460 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:05.584333 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 266/530] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:05.587302 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c3512-bd04-49bd-8a0f-b747ed912d57 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:05.697902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c3512-bd04-49bd-8a0f-b747ed912d57 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:05.735825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534c317-8c63-4d5a-889e-58521044445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:05.736904 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534c317-8c63-4d5a-889e-58521044445a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:05.737395 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534c317-8c63-4d5a-889e-58521044445a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:05.737871 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534c317-8c63-4d5a-889e-58521044445a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:05.739153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534c317-8c63-4d5a-889e-58521044445a None admin] RBAC: Adding query filter params (role.id=81782254e8c2428284b8181e87647f8a, scope.project.id=6897068dc29445f7878c7c12a0915d48, user.id=c2ed2d73e1984404b8099b18a9bb7594) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:05.739657 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534c317-8c63-4d5a-889e-58521044445a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:05.741312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534c317-8c63-4d5a-889e-58521044445a None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:05.748587 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 265/531] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:14:05 2022] GET /identity/v3/role_assignments?user.id=c2ed2d73e1984404b8099b18a9bb7594&scope.project.id=6897068dc29445f7878c7c12a0915d48&role.id=81782254e8c2428284b8181e87647f8a => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:06.932407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d61792-3077-4f1b-b929-e72663b63c13 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:06.933730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d61792-3077-4f1b-b929-e72663b63c13 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:06.934497 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d61792-3077-4f1b-b929-e72663b63c13 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:06.937576 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 267/532] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:06.942962 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fff79d-ea05-4854-bc9b-fa76a3e5ca56 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:06.943536 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fff79d-ea05-4854-bc9b-fa76a3e5ca56 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:06.943536 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fff79d-ea05-4854-bc9b-fa76a3e5ca56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:06.963478 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-50fff79d-ea05-4854-bc9b-fa76a3e5ca56 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:06.964694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-50fff79d-ea05-4854-bc9b-fa76a3e5ca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:07.017324 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:07.051893 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 266/533] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:14:07.075379 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d61792-3077-4f1b-b929-e72663b63c13 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:07.152898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:07.186218 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d61792-3077-4f1b-b929-e72663b63c13 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:07.225890 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29cdb9-c737-4b38-bdf0-9ec366e8e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:07.226966 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29cdb9-c737-4b38-bdf0-9ec366e8e569 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:07.227444 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29cdb9-c737-4b38-bdf0-9ec366e8e569 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:07.227957 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29cdb9-c737-4b38-bdf0-9ec366e8e569 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:07.238991 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29cdb9-c737-4b38-bdf0-9ec366e8e569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-2b29cdb9-c737-4b38-bdf0-9ec366e8e569 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:07.244184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:07.245104 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:07.245924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:07.245924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:07.245924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:07.245924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:07.245924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:07.245924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:07.245924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:07.245924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:07.245924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:07.245924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:07.245924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:07.245924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:07.248671 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 268/534] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:14:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:07.254755 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fff79d-ea05-4854-bc9b-fa76a3e5ca56 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:07.357768 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7b6e0-c76a-41df-bcf5-ef9785f6e912 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:07.358067 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7b6e0-c76a-41df-bcf5-ef9785f6e912 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:07.358308 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7b6e0-c76a-41df-bcf5-ef9785f6e912 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:07.359936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 269/535] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:07.365346 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc154a-efbb-437e-aa92-fc6cd5cab633 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:07.365620 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc154a-efbb-437e-aa92-fc6cd5cab633 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:07.365892 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc154a-efbb-437e-aa92-fc6cd5cab633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:07.368721 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fff79d-ea05-4854-bc9b-fa76a3e5ca56 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:07.389420 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-93dc154a-efbb-437e-aa92-fc6cd5cab633 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:07.390750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-93dc154a-efbb-437e-aa92-fc6cd5cab633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:07.413168 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6233efe-9966-4eb8-8430-2295da5334e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:07.414218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6233efe-9966-4eb8-8430-2295da5334e4 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:07.414754 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6233efe-9966-4eb8-8430-2295da5334e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:07.415232 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6233efe-9966-4eb8-8430-2295da5334e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:07.416247 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6233efe-9966-4eb8-8430-2295da5334e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:07.416754 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6233efe-9966-4eb8-8430-2295da5334e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:07.418654 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6233efe-9966-4eb8-8430-2295da5334e4 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:07.428245 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 267/536] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Jul 26 10:14:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:07.438596 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6233efe-9966-4eb8-8430-2295da5334e4 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:07.466186 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 270/537] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:14:07.479261 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:07.491943 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc154a-efbb-437e-aa92-fc6cd5cab633 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:07.554297 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:07.555053 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6233efe-9966-4eb8-8430-2295da5334e4 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:07.597676 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbc20f-9d2a-4c23-8195-7a6247c4260d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:07.599477 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbc20f-9d2a-4c23-8195-7a6247c4260d None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:07.599872 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbc20f-9d2a-4c23-8195-7a6247c4260d None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:07.600249 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbc20f-9d2a-4c23-8195-7a6247c4260d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:07.607983 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc154a-efbb-437e-aa92-fc6cd5cab633 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:07.615604 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbc20f-9d2a-4c23-8195-7a6247c4260d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:07.617412 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbc20f-9d2a-4c23-8195-7a6247c4260d None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:07.638683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-93cbc20f-9d2a-4c23-8195-7a6247c4260d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:07.638683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:07.638683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:07.638683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:07.638683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:07.638683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:07.638683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:07.638683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:07.638683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:07.638683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:07.638683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:07.638683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:07.638683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:07.638683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:07.638683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:07.639814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:07.640892 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:07.640892 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:07.640892 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:07.640892 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:07.642567 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 268/538] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:07.646196 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbc20f-9d2a-4c23-8195-7a6247c4260d None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:07.665101 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d2e08-28bf-4384-99a2-b76f4a64c246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:07.666666 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d2e08-28bf-4384-99a2-b76f4a64c246 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:07.667120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d2e08-28bf-4384-99a2-b76f4a64c246 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:07.667548 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d2e08-28bf-4384-99a2-b76f4a64c246 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:07.683382 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d2e08-28bf-4384-99a2-b76f4a64c246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-933d2e08-28bf-4384-99a2-b76f4a64c246 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:07.690270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:07.691423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:07.692436 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:07.692436 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:07.692436 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:07.692436 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:07.692436 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:07.692436 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:07.692436 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:07.692436 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:07.692436 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:07.692436 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:07.692436 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:07.692436 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:07.695022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 271/539] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:14:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:07.701458 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d2e08-28bf-4384-99a2-b76f4a64c246 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:07.759244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:07.772243 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbc20f-9d2a-4c23-8195-7a6247c4260d None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:07.805911 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d2e08-28bf-4384-99a2-b76f4a64c246 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:07.808957 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d5358-d2f4-4cf5-9e1a-9f7ffe419ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:07.809641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d5358-d2f4-4cf5-9e1a-9f7ffe419ebb None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:07.809924 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d5358-d2f4-4cf5-9e1a-9f7ffe419ebb None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:07.810195 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d5358-d2f4-4cf5-9e1a-9f7ffe419ebb None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:07.810934 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d5358-d2f4-4cf5-9e1a-9f7ffe419ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:07.811239 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d5358-d2f4-4cf5-9e1a-9f7ffe419ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:07.812625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d5358-d2f4-4cf5-9e1a-9f7ffe419ebb None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:07.825421 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 269/540] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:07.826701 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09017-baa7-4393-be42-4b4ad1106167 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:07.826985 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09017-baa7-4393-be42-4b4ad1106167 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:07.827254 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09017-baa7-4393-be42-4b4ad1106167 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:07.830484 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 270/541] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:07.830754 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09017-baa7-4393-be42-4b4ad1106167 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:07.836444 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:07.853309 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa34f21-97fd-4d68-be3a-73939a5d9371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:07.854081 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa34f21-97fd-4d68-be3a-73939a5d9371 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:07.854359 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa34f21-97fd-4d68-be3a-73939a5d9371 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:07.854751 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa34f21-97fd-4d68-be3a-73939a5d9371 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:07.855520 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa34f21-97fd-4d68-be3a-73939a5d9371 None admin] RBAC: Adding query filter params (name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:07.855873 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa34f21-97fd-4d68-be3a-73939a5d9371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:07.857513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa34f21-97fd-4d68-be3a-73939a5d9371 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:07.867257 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 272/542] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Jul 26 10:14:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:07.868394 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84109ce3-8a4a-4b45-99f3-45b992dafeb3 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:07.868681 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84109ce3-8a4a-4b45-99f3-45b992dafeb3 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:07.868956 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84109ce3-8a4a-4b45-99f3-45b992dafeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:07.889097 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-84109ce3-8a4a-4b45-99f3-45b992dafeb3 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:07.890610 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-84109ce3-8a4a-4b45-99f3-45b992dafeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:07.948604 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09017-baa7-4393-be42-4b4ad1106167 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:07.965500 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 273/543] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:14:07.967780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84109ce3-8a4a-4b45-99f3-45b992dafeb3 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:07.985061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e353c-7e04-460d-99cf-6419bccbdfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:07.985851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e353c-7e04-460d-99cf-6419bccbdfa4 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:07.986235 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e353c-7e04-460d-99cf-6419bccbdfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:07.986609 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e353c-7e04-460d-99cf-6419bccbdfa4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:07.994656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e353c-7e04-460d-99cf-6419bccbdfa4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:07.996147 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e353c-7e04-460d-99cf-6419bccbdfa4 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-0d0e353c-7e04-460d-99cf-6419bccbdfa4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:08.008380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:08.009364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:08.010259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:08.010259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:08.010259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:08.010259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:08.010259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:08.010259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:08.010259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:08.010259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:08.010259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:14:08.010259 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:08.016359 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 271/544] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Jul 26 10:14:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:08.016359 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e353c-7e04-460d-99cf-6419bccbdfa4 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:08.030669 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:08.078855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84109ce3-8a4a-4b45-99f3-45b992dafeb3 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:08.092253 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:08.115903 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e880c-04c6-4325-bddc-d5f460c27190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:08.116563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e880c-04c6-4325-bddc-d5f460c27190 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:08.116845 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e880c-04c6-4325-bddc-d5f460c27190 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:08.117123 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e880c-04c6-4325-bddc-d5f460c27190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:08.119897 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e353c-7e04-460d-99cf-6419bccbdfa4 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:08.127826 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e880c-04c6-4325-bddc-d5f460c27190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:08.129329 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e880c-04c6-4325-bddc-d5f460c27190 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:08.144970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-197e880c-04c6-4325-bddc-d5f460c27190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:08.144970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:08.144970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:08.144970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:08.144970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:08.144970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:08.144970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:08.144970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:08.144970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:08.144970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:08.144970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:08.144970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:08.144970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:08.144970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:08.144970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:08.145839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:08.146937 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:08.146937 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:08.146937 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:08.146937 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:08.146937 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 274/545] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:08.146937 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e880c-04c6-4325-bddc-d5f460c27190 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:08.157235 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027cdfe-4fe9-405e-b687-4c68650fe633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:08.157877 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027cdfe-4fe9-405e-b687-4c68650fe633 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:08.158150 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027cdfe-4fe9-405e-b687-4c68650fe633 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:08.158402 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027cdfe-4fe9-405e-b687-4c68650fe633 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:08.169555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027cdfe-4fe9-405e-b687-4c68650fe633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-e027cdfe-4fe9-405e-b687-4c68650fe633 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:08.174887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:08.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:08.176812 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:08.176812 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:08.176812 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:08.176812 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:08.176812 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:08.176812 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:08.176812 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:08.176812 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:08.176812 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:08.176812 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:08.176812 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:08.176812 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:08.176812 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 272/546] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:14:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:08.177492 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40464343-05bf-4308-b288-6bc6b3b094d7 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:08.177492 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40464343-05bf-4308-b288-6bc6b3b094d7 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:08.177702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40464343-05bf-4308-b288-6bc6b3b094d7 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:08.179189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 273/547] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:08.179860 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40464343-05bf-4308-b288-6bc6b3b094d7 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:08.251185 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:08.255957 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e880c-04c6-4325-bddc-d5f460c27190 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:08.287666 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40464343-05bf-4308-b288-6bc6b3b094d7 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:08.289783 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885c2fa-6add-4b04-b685-9ba09cd0ca09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:08.290408 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885c2fa-6add-4b04-b685-9ba09cd0ca09 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:08.290722 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885c2fa-6add-4b04-b685-9ba09cd0ca09 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:08.290997 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885c2fa-6add-4b04-b685-9ba09cd0ca09 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:08.291831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885c2fa-6add-4b04-b685-9ba09cd0ca09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:08.292142 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885c2fa-6add-4b04-b685-9ba09cd0ca09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:08.293652 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885c2fa-6add-4b04-b685-9ba09cd0ca09 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:08.310620 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 275/548] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Jul 26 10:14:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:08.311430 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885c2fa-6add-4b04-b685-9ba09cd0ca09 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:08.323054 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c6016-d6d9-4a9a-9931-120ee3957459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:08.323673 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c6016-d6d9-4a9a-9931-120ee3957459 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:08.323943 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c6016-d6d9-4a9a-9931-120ee3957459 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:08.324246 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c6016-d6d9-4a9a-9931-120ee3957459 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:08.325030 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c6016-d6d9-4a9a-9931-120ee3957459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:08.325326 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c6016-d6d9-4a9a-9931-120ee3957459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:08.326721 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c6016-d6d9-4a9a-9931-120ee3957459 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:08.336131 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:08.338371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 274/549] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:08.339581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7f6bb-6f3c-4d62-8488-075aa8e30655 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:08.339885 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7f6bb-6f3c-4d62-8488-075aa8e30655 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:08.340320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7f6bb-6f3c-4d62-8488-075aa8e30655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:08.359523 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-dbf7f6bb-6f3c-4d62-8488-075aa8e30655 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:08.360730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-dbf7f6bb-6f3c-4d62-8488-075aa8e30655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:08.412228 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885c2fa-6add-4b04-b685-9ba09cd0ca09 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:08.426875 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 275/550] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:14:08.442648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7f6bb-6f3c-4d62-8488-075aa8e30655 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:08.447814 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c786a-301a-4cad-a46b-a85d0eb61f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:08.448439 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c786a-301a-4cad-a46b-a85d0eb61f38 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:08.448716 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c786a-301a-4cad-a46b-a85d0eb61f38 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:08.448986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c786a-301a-4cad-a46b-a85d0eb61f38 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:08.449779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c786a-301a-4cad-a46b-a85d0eb61f38 None admin] RBAC: Adding query filter params (name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:08.450079 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c786a-301a-4cad-a46b-a85d0eb61f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:08.457421 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c786a-301a-4cad-a46b-a85d0eb61f38 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:08.465361 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 276/551] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Jul 26 10:14:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:08.466225 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c786a-301a-4cad-a46b-a85d0eb61f38 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:08.492923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:08.535377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7f6bb-6f3c-4d62-8488-075aa8e30655 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:08.552427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:08.568396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c786a-301a-4cad-a46b-a85d0eb61f38 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:08.569381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d98b1e-2019-41a4-9bed-2647fc5e5ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:08.570036 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d98b1e-2019-41a4-9bed-2647fc5e5ce4 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:08.570315 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d98b1e-2019-41a4-9bed-2647fc5e5ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:08.570632 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d98b1e-2019-41a4-9bed-2647fc5e5ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:08.581359 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d98b1e-2019-41a4-9bed-2647fc5e5ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:08.582866 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d98b1e-2019-41a4-9bed-2647fc5e5ce4 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:08.599188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-b7d98b1e-2019-41a4-9bed-2647fc5e5ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:08.599188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:08.599188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:08.599188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:08.599188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:08.599188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:08.599188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:08.599188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:08.599188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:08.599188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:08.599188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:08.599188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:08.599188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:08.599188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:08.599188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:08.600268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:08.601581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:08.601581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:08.601581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:08.601581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:08.601581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 276/552] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:08.601581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d98b1e-2019-41a4-9bed-2647fc5e5ce4 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:08.611964 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d9fc8-e184-46e5-9524-75f28c6c1169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:08.612668 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d9fc8-e184-46e5-9524-75f28c6c1169 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:08.612924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d9fc8-e184-46e5-9524-75f28c6c1169 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:08.613165 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d9fc8-e184-46e5-9524-75f28c6c1169 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:08.621936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d9fc8-e184-46e5-9524-75f28c6c1169 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:08.623484 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d9fc8-e184-46e5-9524-75f28c6c1169 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-de7d9fc8-e184-46e5-9524-75f28c6c1169 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:08.634910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:08.635872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:08.636786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:08.636786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:08.636786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:08.636786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:08.636786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:08.636786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:08.636786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:08.636786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:08.636786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 10:14:08.636786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:08.636786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 277/553] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:08.637849 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d9fc8-e184-46e5-9524-75f28c6c1169 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:08.712204 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d98b1e-2019-41a4-9bed-2647fc5e5ce4 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:08.722412 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:08.735760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d9fc8-e184-46e5-9524-75f28c6c1169 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:08.746888 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24650f1a-5dd9-498c-a505-3e0964180f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:08.747534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24650f1a-5dd9-498c-a505-3e0964180f26 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:08.747814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24650f1a-5dd9-498c-a505-3e0964180f26 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:08.748084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24650f1a-5dd9-498c-a505-3e0964180f26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:08.758337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24650f1a-5dd9-498c-a505-3e0964180f26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-24650f1a-5dd9-498c-a505-3e0964180f26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:08.763851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:08.765097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:08.766079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:08.766079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:08.766079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:08.766079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:08.766079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:08.766079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:08.766079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:08.766079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:08.766079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:08.766079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:08.766079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:08.766079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:08.766079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 277/554] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:14:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:08.766079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24650f1a-5dd9-498c-a505-3e0964180f26 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:08.772670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693482e-e2c4-42e4-9d13-a0baebb78d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:08.773322 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693482e-e2c4-42e4-9d13-a0baebb78d31 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:08.773602 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693482e-e2c4-42e4-9d13-a0baebb78d31 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:08.773930 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693482e-e2c4-42e4-9d13-a0baebb78d31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:08.786079 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693482e-e2c4-42e4-9d13-a0baebb78d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:08.787542 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693482e-e2c4-42e4-9d13-a0baebb78d31 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:08.790563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:08.803538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-3693482e-e2c4-42e4-9d13-a0baebb78d31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:08.803538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:08.803538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:08.803538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:08.803538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:08.803538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:08.803538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:08.803538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:08.803538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:08.803538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:08.803538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:08.803538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:08.803538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:08.803538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:08.803538 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:08.804588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:08.805612 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:08.805612 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:08.805612 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:08.805612 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:08.805612 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 278/555] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:08.810410 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693482e-e2c4-42e4-9d13-a0baebb78d31 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:08.866311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24650f1a-5dd9-498c-a505-3e0964180f26 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:08.899982 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25989107-59af-459c-b3ad-c82f7e0f1928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:08.900584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25989107-59af-459c-b3ad-c82f7e0f1928 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:08.900871 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25989107-59af-459c-b3ad-c82f7e0f1928 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:08.901130 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25989107-59af-459c-b3ad-c82f7e0f1928 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:08.901818 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25989107-59af-459c-b3ad-c82f7e0f1928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:08.902119 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25989107-59af-459c-b3ad-c82f7e0f1928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:08.903597 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25989107-59af-459c-b3ad-c82f7e0f1928 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:08.908790 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693482e-e2c4-42e4-9d13-a0baebb78d31 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:08.915293 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 278/556] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:08.916070 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25989107-59af-459c-b3ad-c82f7e0f1928 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:08.944245 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542cac-c9ca-40f0-8dc5-abb371315fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:08.944889 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542cac-c9ca-40f0-8dc5-abb371315fb1 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:08.945153 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542cac-c9ca-40f0-8dc5-abb371315fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:08.945410 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542cac-c9ca-40f0-8dc5-abb371315fb1 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:08.946219 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef542cac-c9ca-40f0-8dc5-abb371315fb1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:08.946562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef542cac-c9ca-40f0-8dc5-abb371315fb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:08.947687 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:08.947986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef542cac-c9ca-40f0-8dc5-abb371315fb1 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:08.966486 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 279/557] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Jul 26 10:14:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:08.966486 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542cac-c9ca-40f0-8dc5-abb371315fb1 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:09.022054 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25989107-59af-459c-b3ad-c82f7e0f1928 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:09.026328 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:09.056441 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d400cb-bf0f-408f-84eb-e897fe3794fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:09.056990 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d400cb-bf0f-408f-84eb-e897fe3794fc None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:09.057279 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d400cb-bf0f-408f-84eb-e897fe3794fc None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:09.057548 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d400cb-bf0f-408f-84eb-e897fe3794fc None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:09.058272 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d400cb-bf0f-408f-84eb-e897fe3794fc None admin] RBAC: Adding query filter params (name=service) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:09.058610 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d400cb-bf0f-408f-84eb-e897fe3794fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:09.060032 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d400cb-bf0f-408f-84eb-e897fe3794fc None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:09.068190 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 279/558] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Jul 26 10:14:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:09.068900 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d400cb-bf0f-408f-84eb-e897fe3794fc None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:09.076467 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542cac-c9ca-40f0-8dc5-abb371315fb1 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:09.111627 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16eff1-6732-4c5a-8172-9baa8ec6201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:09.112415 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16eff1-6732-4c5a-8172-9baa8ec6201b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:09.112818 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16eff1-6732-4c5a-8172-9baa8ec6201b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:09.113070 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16eff1-6732-4c5a-8172-9baa8ec6201b None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:09.113871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16eff1-6732-4c5a-8172-9baa8ec6201b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:09.114248 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16eff1-6732-4c5a-8172-9baa8ec6201b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:09.118237 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16eff1-6732-4c5a-8172-9baa8ec6201b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:09.127458 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 280/559] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:09.129473 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16eff1-6732-4c5a-8172-9baa8ec6201b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:09.165205 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:09.174166 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d400cb-bf0f-408f-84eb-e897fe3794fc None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:09.207086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3436e79-bff4-4a92-970f-1cf6c509262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:09.207726 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3436e79-bff4-4a92-970f-1cf6c509262b None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:09.208003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3436e79-bff4-4a92-970f-1cf6c509262b None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:09.208272 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3436e79-bff4-4a92-970f-1cf6c509262b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:09.216193 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3436e79-bff4-4a92-970f-1cf6c509262b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:09.217672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3436e79-bff4-4a92-970f-1cf6c509262b None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:09.227952 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16eff1-6732-4c5a-8172-9baa8ec6201b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:09.229263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-e3436e79-bff4-4a92-970f-1cf6c509262b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:09.229263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:09.229263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:09.229263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:09.229263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:09.229263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:09.229263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:09.229263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:09.229263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:09.229263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:09.229263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:09.229263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:09.229263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:09.229263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:09.229263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:09.230320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:09.231419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:09.231419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:09.231419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:09.231419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:09.231419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:09.231419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:09.231419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:09.231419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:09.231419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 280/560] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:09.231419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3436e79-bff4-4a92-970f-1cf6c509262b None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:09.245189 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:09.266518 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c8c40-3b52-4074-9cb1-fcc84f17d5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:09.267168 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c8c40-3b52-4074-9cb1-fcc84f17d5c6 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:09.267466 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c8c40-3b52-4074-9cb1-fcc84f17d5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:09.267949 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c8c40-3b52-4074-9cb1-fcc84f17d5c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:09.278264 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c8c40-3b52-4074-9cb1-fcc84f17d5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:09.279765 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c8c40-3b52-4074-9cb1-fcc84f17d5c6 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:09.294221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-dc4c8c40-3b52-4074-9cb1-fcc84f17d5c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:09.294221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:09.294221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:09.294221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:09.294221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:09.294221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:09.294221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:09.294221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:09.294221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:09.294221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:09.294221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:09.294221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:09.294221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:09.294221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:09.294221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:09.295233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:09.296140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:09.296140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:09.296140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:09.296140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:09.296140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 281/561] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:09.296140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c8c40-3b52-4074-9cb1-fcc84f17d5c6 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:09.333465 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3436e79-bff4-4a92-970f-1cf6c509262b None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:09.370222 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569674a0-2674-43c6-8c76-3b17f66f3b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:09.370896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569674a0-2674-43c6-8c76-3b17f66f3b44 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:09.371173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569674a0-2674-43c6-8c76-3b17f66f3b44 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:09.371539 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569674a0-2674-43c6-8c76-3b17f66f3b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:09.383550 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569674a0-2674-43c6-8c76-3b17f66f3b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:09.385420 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569674a0-2674-43c6-8c76-3b17f66f3b44 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:09.397100 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c8c40-3b52-4074-9cb1-fcc84f17d5c6 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:09.400090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-569674a0-2674-43c6-8c76-3b17f66f3b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:09.400090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:09.400090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:09.400090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:09.400090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:09.400090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:09.400090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:09.400090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:09.400090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:09.400090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:09.400090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:09.400090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:09.400090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:09.400090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:09.400090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:09.401085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:09.402074 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:09.402074 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:09.402074 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:09.402074 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:09.402074 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 281/562] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:09.402351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569674a0-2674-43c6-8c76-3b17f66f3b44 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:09.407276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:09.432340 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c6fca-e539-4a2e-98c3-184f80d2134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:09.433270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c6fca-e539-4a2e-98c3-184f80d2134e None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:09.433535 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c6fca-e539-4a2e-98c3-184f80d2134e None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:09.433806 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c6fca-e539-4a2e-98c3-184f80d2134e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:09.441748 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c6fca-e539-4a2e-98c3-184f80d2134e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:09.443229 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c6fca-e539-4a2e-98c3-184f80d2134e None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-2b9c6fca-e539-4a2e-98c3-184f80d2134e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:09.454595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:09.455667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:09.461566 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:09.461566 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:09.461566 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:09.461566 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:09.461566 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:09.461566 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:09.461566 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:09.461566 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:09.461566 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:14:09.461566 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:09.461566 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 282/563] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:09.461566 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c6fca-e539-4a2e-98c3-184f80d2134e None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:09.483995 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:09.506211 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569674a0-2674-43c6-8c76-3b17f66f3b44 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:09.541119 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72e059-5050-4431-9a90-f6489b4d095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:09.541729 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72e059-5050-4431-9a90-f6489b4d095d None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:09.542005 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72e059-5050-4431-9a90-f6489b4d095d None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:09.542275 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72e059-5050-4431-9a90-f6489b4d095d None admin] PATH_INFO: `/v3/projects` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:09.543064 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72e059-5050-4431-9a90-f6489b4d095d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:09.543395 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72e059-5050-4431-9a90-f6489b4d095d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:09.544829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72e059-5050-4431-9a90-f6489b4d095d None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:09.556968 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 282/564] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:14:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:09.557777 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72e059-5050-4431-9a90-f6489b4d095d None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:09.557867 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c6fca-e539-4a2e-98c3-184f80d2134e None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:09.595727 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0c627-8f49-4824-a812-39cc9b76b47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:09.596266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0c627-8f49-4824-a812-39cc9b76b47a None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:09.596550 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0c627-8f49-4824-a812-39cc9b76b47a None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:09.596847 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0c627-8f49-4824-a812-39cc9b76b47a None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:09.597551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0c627-8f49-4824-a812-39cc9b76b47a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:09.597857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0c627-8f49-4824-a812-39cc9b76b47a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:09.599293 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0c627-8f49-4824-a812-39cc9b76b47a None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:09.611936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 283/565] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:09.612858 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0c627-8f49-4824-a812-39cc9b76b47a None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:09.624846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:09.663988 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72e059-5050-4431-9a90-f6489b4d095d None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:09.697789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad88288-6457-4895-95d7-586ae8dd36f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:09.698405 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad88288-6457-4895-95d7-586ae8dd36f7 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:09.698703 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad88288-6457-4895-95d7-586ae8dd36f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:09.698969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad88288-6457-4895-95d7-586ae8dd36f7 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:09.699747 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad88288-6457-4895-95d7-586ae8dd36f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:09.700027 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad88288-6457-4895-95d7-586ae8dd36f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:09.701401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad88288-6457-4895-95d7-586ae8dd36f7 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:09.703485 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:09.713283 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 283/566] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:09.713283 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad88288-6457-4895-95d7-586ae8dd36f7 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:09.719222 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0c627-8f49-4824-a812-39cc9b76b47a None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:09.754221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275f82b-5763-41c2-a93c-999e53bb0cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:09.754885 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275f82b-5763-41c2-a93c-999e53bb0cb4 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:09.755167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275f82b-5763-41c2-a93c-999e53bb0cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:09.755446 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275f82b-5763-41c2-a93c-999e53bb0cb4 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:09.756247 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275f82b-5763-41c2-a93c-999e53bb0cb4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:09.756559 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275f82b-5763-41c2-a93c-999e53bb0cb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:09.757967 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275f82b-5763-41c2-a93c-999e53bb0cb4 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:09.776090 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 284/567] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Jul 26 10:14:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:09.777121 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275f82b-5763-41c2-a93c-999e53bb0cb4 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:09.819351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad88288-6457-4895-95d7-586ae8dd36f7 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:09.842716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:09.853953 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83196e99-6800-4270-91c7-1fec5efcac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:09.854599 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83196e99-6800-4270-91c7-1fec5efcac75 None admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:09.854881 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83196e99-6800-4270-91c7-1fec5efcac75 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:09.855154 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83196e99-6800-4270-91c7-1fec5efcac75 None admin] PATH_INFO: `/v3/projects/6897068dc29445f7878c7c12a0915d48/users/d68b323bc2b54984ad2ed0d248675624/roles/81782254e8c2428284b8181e87647f8a` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:09.869627 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83196e99-6800-4270-91c7-1fec5efcac75 None admin] RBAC: Authorizing `identity:create_grant(project_id=6897068dc29445f7878c7c12a0915d48, user_id=d68b323bc2b54984ad2ed0d248675624, role_id=81782254e8c2428284b8181e87647f8a)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:09.871127 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83196e99-6800-4270-91c7-1fec5efcac75 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:09.876456 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275f82b-5763-41c2-a93c-999e53bb0cb4 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:09.884774 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 284/568] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:14:09 2022] PUT /identity/v3/projects/6897068dc29445f7878c7c12a0915d48/users/d68b323bc2b54984ad2ed0d248675624/roles/81782254e8c2428284b8181e87647f8a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:14:09.885745 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83196e99-6800-4270-91c7-1fec5efcac75 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:09.927139 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518c75b-c735-41c4-b8c0-cab30f52af40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:09.927828 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518c75b-c735-41c4-b8c0-cab30f52af40 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:09.928110 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518c75b-c735-41c4-b8c0-cab30f52af40 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:09.928385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518c75b-c735-41c4-b8c0-cab30f52af40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:09.936174 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518c75b-c735-41c4-b8c0-cab30f52af40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:09.937636 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518c75b-c735-41c4-b8c0-cab30f52af40 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:09.950319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-9518c75b-c735-41c4-b8c0-cab30f52af40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:09.950319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:09.950319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:09.950319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:09.950319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:09.950319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:09.950319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:09.950319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:09.950319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:09.950319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:09.950319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:09.950319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:09.950319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:09.950319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:09.950319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:09.951513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:09.952607 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:09.952607 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:09.952607 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:09.952607 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:09.952607 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:09.952607 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:09.952607 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:09.952607 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:09.955034 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 285/569] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:09.956125 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518c75b-c735-41c4-b8c0-cab30f52af40 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:09.961305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:10.011819 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83196e99-6800-4270-91c7-1fec5efcac75 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:10.054736 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb08316-1764-44cd-87e9-d1f644a820c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:10.055763 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb08316-1764-44cd-87e9-d1f644a820c3 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:10.056046 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb08316-1764-44cd-87e9-d1f644a820c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:10.056325 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb08316-1764-44cd-87e9-d1f644a820c3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:10.067430 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb08316-1764-44cd-87e9-d1f644a820c3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:10.068102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb08316-1764-44cd-87e9-d1f644a820c3 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-5fb08316-1764-44cd-87e9-d1f644a820c3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:10.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:10.084003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:10.085117 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:10.085117 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:10.085117 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:10.085117 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:10.085117 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:10.085117 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:10.085117 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:10.085117 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:10.085117 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 10:14:10.085117 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:10.085117 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 285/570] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:14:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:10.085819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518c75b-c735-41c4-b8c0-cab30f52af40 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:10.086236 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb08316-1764-44cd-87e9-d1f644a820c3 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:10.123021 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:10.129447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26ce97-ccd6-4601-bdea-215cb374b77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:10.130098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26ce97-ccd6-4601-bdea-215cb374b77d None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:10.130375 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26ce97-ccd6-4601-bdea-215cb374b77d None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:10.130688 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26ce97-ccd6-4601-bdea-215cb374b77d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:10.142167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26ce97-ccd6-4601-bdea-215cb374b77d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:10.143701 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26ce97-ccd6-4601-bdea-215cb374b77d None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:10.158730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-3b26ce97-ccd6-4601-bdea-215cb374b77d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:10.158730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:10.158730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:10.158730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:10.158730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:10.158730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:10.158730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:10.158730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:10.158730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:10.158730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:10.158730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:10.158730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:10.158730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:10.158730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:10.158730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:10.159913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:10.160819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:10.160819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:10.160819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:10.160819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:10.160819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 286/571] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:10.161102 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26ce97-ccd6-4601-bdea-215cb374b77d None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:10.199637 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb08316-1764-44cd-87e9-d1f644a820c3 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:10.221320 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:10.235438 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a33e7f-bcc7-47bd-b4e7-4ed8cc90948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:10.236066 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a33e7f-bcc7-47bd-b4e7-4ed8cc90948d None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:10.236340 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a33e7f-bcc7-47bd-b4e7-4ed8cc90948d None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:10.236614 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a33e7f-bcc7-47bd-b4e7-4ed8cc90948d None admin] PATH_INFO: `/v3/projects` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:10.237370 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a33e7f-bcc7-47bd-b4e7-4ed8cc90948d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:10.237676 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a33e7f-bcc7-47bd-b4e7-4ed8cc90948d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:10.239162 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a33e7f-bcc7-47bd-b4e7-4ed8cc90948d None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:10.251978 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 286/572] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:10.252824 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a33e7f-bcc7-47bd-b4e7-4ed8cc90948d None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:10.278583 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26ce97-ccd6-4601-bdea-215cb374b77d None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:10.318001 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0f71a-60b7-4f95-ab4e-7be544ff8048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:10.319003 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0f71a-60b7-4f95-ab4e-7be544ff8048 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:10.319411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0f71a-60b7-4f95-ab4e-7be544ff8048 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:10.319755 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0f71a-60b7-4f95-ab4e-7be544ff8048 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:10.320743 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0f71a-60b7-4f95-ab4e-7be544ff8048 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:10.321122 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0f71a-60b7-4f95-ab4e-7be544ff8048 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:10.322819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0f71a-60b7-4f95-ab4e-7be544ff8048 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:10.342853 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 287/573] 10.222.0.60 () {56 vars in 1139 bytes} [Tue Jul 26 10:14:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:10.343989 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0f71a-60b7-4f95-ab4e-7be544ff8048 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:10.358746 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:10.366683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a33e7f-bcc7-47bd-b4e7-4ed8cc90948d None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:10.416994 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c44d4a-893a-4cad-890c-1d0bda58ab83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:10.417628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c44d4a-893a-4cad-890c-1d0bda58ab83 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:10.417900 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c44d4a-893a-4cad-890c-1d0bda58ab83 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:10.418222 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c44d4a-893a-4cad-890c-1d0bda58ab83 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:10.418975 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c44d4a-893a-4cad-890c-1d0bda58ab83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:10.419282 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c44d4a-893a-4cad-890c-1d0bda58ab83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:10.420664 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c44d4a-893a-4cad-890c-1d0bda58ab83 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:10.432777 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 287/574] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:10.433437 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c44d4a-893a-4cad-890c-1d0bda58ab83 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:10.472829 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0f71a-60b7-4f95-ab4e-7be544ff8048 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:10.488984 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:10.512321 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39923ab-12af-4c98-8abf-9543081736a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:10.513008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39923ab-12af-4c98-8abf-9543081736a9 None admin] REQUEST_METHOD: `PUT` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:10.513317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39923ab-12af-4c98-8abf-9543081736a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:10.513591 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39923ab-12af-4c98-8abf-9543081736a9 None admin] PATH_INFO: `/v3/projects/6897068dc29445f7878c7c12a0915d48/users/7f4adbb70e9f46f9a6a416329e8c0bf2/roles/81782254e8c2428284b8181e87647f8a` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:10.528446 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39923ab-12af-4c98-8abf-9543081736a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6897068dc29445f7878c7c12a0915d48, user_id=7f4adbb70e9f46f9a6a416329e8c0bf2, role_id=81782254e8c2428284b8181e87647f8a)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:10.529911 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39923ab-12af-4c98-8abf-9543081736a9 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:10.542225 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c44d4a-893a-4cad-890c-1d0bda58ab83 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:10.545814 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 288/575] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:14:10 2022] PUT /identity/v3/projects/6897068dc29445f7878c7c12a0915d48/users/7f4adbb70e9f46f9a6a416329e8c0bf2/roles/81782254e8c2428284b8181e87647f8a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:14:10.551405 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39923ab-12af-4c98-8abf-9543081736a9 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:10.593762 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e0f9d-231f-4be9-9209-fb8a4884a506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:10.594743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e0f9d-231f-4be9-9209-fb8a4884a506 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:10.595187 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e0f9d-231f-4be9-9209-fb8a4884a506 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:10.595618 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e0f9d-231f-4be9-9209-fb8a4884a506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:10.608996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e0f9d-231f-4be9-9209-fb8a4884a506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:10.611039 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e0f9d-231f-4be9-9209-fb8a4884a506 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:10.628579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-b60e0f9d-231f-4be9-9209-fb8a4884a506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:10.628579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:10.628579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:10.628579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:10.628579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:10.628579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:10.628579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:10.628579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:10.628579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:10.628579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:10.628579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:10.628579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:10.628579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:10.628579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:10.628579 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:10.629555 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:10.630482 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:10.630482 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:10.630482 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:10.630482 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:10.633206 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 288/576] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:10.638669 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e0f9d-231f-4be9-9209-fb8a4884a506 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:10.654415 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:10.709816 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39923ab-12af-4c98-8abf-9543081736a9 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:10.758130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f690ea-fd05-4682-a9d3-fccc0c35b8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:10.758824 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f690ea-fd05-4682-a9d3-fccc0c35b8d0 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:10.759163 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f690ea-fd05-4682-a9d3-fccc0c35b8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:10.759371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f690ea-fd05-4682-a9d3-fccc0c35b8d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:10.767091 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f690ea-fd05-4682-a9d3-fccc0c35b8d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:10.769221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f690ea-fd05-4682-a9d3-fccc0c35b8d0 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:10.781747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-17f690ea-fd05-4682-a9d3-fccc0c35b8d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:10.781747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:10.781747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:10.781747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:10.781747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:10.781747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:10.781747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:10.781747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:10.781747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:10.781747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:10.781747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:10.781747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:10.781747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:10.781747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:10.781747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:10.782747 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:10.783664 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:10.783664 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:10.783664 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:10.783664 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:10.783664 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:10.783664 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:10.783664 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:10.783664 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:10.783664 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 289/577] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:10.789339 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f690ea-fd05-4682-a9d3-fccc0c35b8d0 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:10.801767 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e0f9d-231f-4be9-9209-fb8a4884a506 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:10.820171 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:10.846992 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b65fc4-90b2-4ac4-8062-a21ed977d9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:10.850375 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b65fc4-90b2-4ac4-8062-a21ed977d9fa None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:10.850690 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b65fc4-90b2-4ac4-8062-a21ed977d9fa None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:10.851068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b65fc4-90b2-4ac4-8062-a21ed977d9fa None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:10.851729 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b65fc4-90b2-4ac4-8062-a21ed977d9fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:10.852032 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b65fc4-90b2-4ac4-8062-a21ed977d9fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:10.854607 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b65fc4-90b2-4ac4-8062-a21ed977d9fa None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:10.868079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 289/578] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:10.873661 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b65fc4-90b2-4ac4-8062-a21ed977d9fa None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:10.914695 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f690ea-fd05-4682-a9d3-fccc0c35b8d0 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:10.944213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:10.964289 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4130e48-f139-44df-ba4e-b0c7fbd42450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:10.965593 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4130e48-f139-44df-ba4e-b0c7fbd42450 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:10.966291 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4130e48-f139-44df-ba4e-b0c7fbd42450 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:10.966793 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4130e48-f139-44df-ba4e-b0c7fbd42450 None admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:10.968173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4130e48-f139-44df-ba4e-b0c7fbd42450 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:10.968682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4130e48-f139-44df-ba4e-b0c7fbd42450 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:10.971029 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4130e48-f139-44df-ba4e-b0c7fbd42450 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:10.982790 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b65fc4-90b2-4ac4-8062-a21ed977d9fa None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:10.988656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 290/579] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:10.994311 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4130e48-f139-44df-ba4e-b0c7fbd42450 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:11.030973 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4d769-9390-4812-952c-e0f02786f817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:11.031725 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4d769-9390-4812-952c-e0f02786f817 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:11.032098 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4d769-9390-4812-952c-e0f02786f817 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:11.032372 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4d769-9390-4812-952c-e0f02786f817 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:11.040261 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4d769-9390-4812-952c-e0f02786f817 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:11.041925 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4d769-9390-4812-952c-e0f02786f817 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:11.056056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-f4c4d769-9390-4812-952c-e0f02786f817 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:11.056056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:11.056056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:11.056056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:11.056056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:11.056056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:11.056056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:11.056056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:11.056056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:11.056056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:11.056056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:11.056056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:11.056056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:11.056056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:11.056056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:11.057623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:11.058956 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:11.058956 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:11.058956 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:11.058956 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:11.058956 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:11.058956 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:11.058956 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:11.058956 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:11.058956 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 290/580] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:11.065261 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4d769-9390-4812-952c-e0f02786f817 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:11.090848 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:11.107920 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4130e48-f139-44df-ba4e-b0c7fbd42450 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:11.143203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b4681-41fa-4b2e-ac37-08c7a2064f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:11.143884 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b4681-41fa-4b2e-ac37-08c7a2064f2b None admin] REQUEST_METHOD: `PUT` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:11.144218 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b4681-41fa-4b2e-ac37-08c7a2064f2b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:11.144500 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b4681-41fa-4b2e-ac37-08c7a2064f2b None admin] PATH_INFO: `/v3/projects/6897068dc29445f7878c7c12a0915d48/users/6a2272bbc60f47fc929b1cc352533f7e/roles/81782254e8c2428284b8181e87647f8a` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:11.161095 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b4681-41fa-4b2e-ac37-08c7a2064f2b None admin] RBAC: Authorizing `identity:create_grant(project_id=6897068dc29445f7878c7c12a0915d48, user_id=6a2272bbc60f47fc929b1cc352533f7e, role_id=81782254e8c2428284b8181e87647f8a)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:11.162946 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b4681-41fa-4b2e-ac37-08c7a2064f2b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:11.177622 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4d769-9390-4812-952c-e0f02786f817 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:11.182793 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 291/581] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:14:10 2022] PUT /identity/v3/projects/6897068dc29445f7878c7c12a0915d48/users/6a2272bbc60f47fc929b1cc352533f7e/roles/81782254e8c2428284b8181e87647f8a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 10:14:11.210845 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:11.221654 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d8bca-1857-4a38-b58c-c676030ba58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:11.222214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d8bca-1857-4a38-b58c-c676030ba58f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:11.222521 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d8bca-1857-4a38-b58c-c676030ba58f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:11.222796 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d8bca-1857-4a38-b58c-c676030ba58f None admin] PATH_INFO: `/v3/projects` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:11.223581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d8bca-1857-4a38-b58c-c676030ba58f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:11.223888 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d8bca-1857-4a38-b58c-c676030ba58f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:11.225427 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d8bca-1857-4a38-b58c-c676030ba58f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:11.239179 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 291/582] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:14:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:11.244913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b4681-41fa-4b2e-ac37-08c7a2064f2b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:11.354449 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b4681-41fa-4b2e-ac37-08c7a2064f2b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:11.399107 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aa3b2-82a1-4b57-8bb6-2ffb3edf6858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:11.399799 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa3b2-82a1-4b57-8bb6-2ffb3edf6858 None admin] REQUEST_METHOD: `PUT` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:11.400080 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa3b2-82a1-4b57-8bb6-2ffb3edf6858 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:11.400349 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa3b2-82a1-4b57-8bb6-2ffb3edf6858 None admin] PATH_INFO: `/v3/projects/6897068dc29445f7878c7c12a0915d48/users/c2ed2d73e1984404b8099b18a9bb7594/roles/81782254e8c2428284b8181e87647f8a` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:11.402966 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:11.419124 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aa3b2-82a1-4b57-8bb6-2ffb3edf6858 None admin] RBAC: Authorizing `identity:create_grant(project_id=6897068dc29445f7878c7c12a0915d48, user_id=c2ed2d73e1984404b8099b18a9bb7594, role_id=81782254e8c2428284b8181e87647f8a)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:11.420919 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aa3b2-82a1-4b57-8bb6-2ffb3edf6858 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:11.435715 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 292/583] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:14:11 2022] PUT /identity/v3/projects/6897068dc29445f7878c7c12a0915d48/users/c2ed2d73e1984404b8099b18a9bb7594/roles/81782254e8c2428284b8181e87647f8a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 10:14:12.195532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87106ab-aa1e-4f33-8ac2-ad80fe7b5e07 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:12.196391 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87106ab-aa1e-4f33-8ac2-ad80fe7b5e07 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:12.196809 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87106ab-aa1e-4f33-8ac2-ad80fe7b5e07 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:12.198656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 292/584] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:12.204554 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb136f-8d46-4a00-8eb3-be34e36438c8 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:12.205444 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb136f-8d46-4a00-8eb3-be34e36438c8 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:12.205916 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb136f-8d46-4a00-8eb3-be34e36438c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:12.225155 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-17cb136f-8d46-4a00-8eb3-be34e36438c8 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:12.226760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-17cb136f-8d46-4a00-8eb3-be34e36438c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:12.302610 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 293/585] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:14:12.323292 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87106ab-aa1e-4f33-8ac2-ad80fe7b5e07 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:12.432530 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87106ab-aa1e-4f33-8ac2-ad80fe7b5e07 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:12.468818 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8310dce-3a11-41af-81ca-cb939d8ebfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:12.469923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8310dce-3a11-41af-81ca-cb939d8ebfd5 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:12.470400 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8310dce-3a11-41af-81ca-cb939d8ebfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:12.470899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8310dce-3a11-41af-81ca-cb939d8ebfd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:12.487962 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8310dce-3a11-41af-81ca-cb939d8ebfd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-b8310dce-3a11-41af-81ca-cb939d8ebfd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:12.492902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:12.493828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:12.495102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:12.495102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:12.495102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:12.495102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:12.495102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:12.495102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:12.495102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:12.495102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:12.495102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:12.495102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:12.495102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:12.495102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:12.495102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 293/586] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:14:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:12.502167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb136f-8d46-4a00-8eb3-be34e36438c8 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:12.614634 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb136f-8d46-4a00-8eb3-be34e36438c8 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:12.634091 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:12.655223 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc4caa-a00b-4d3a-bf24-dd570fe10025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:12.655857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc4caa-a00b-4d3a-bf24-dd570fe10025 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:12.656133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc4caa-a00b-4d3a-bf24-dd570fe10025 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:12.656400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc4caa-a00b-4d3a-bf24-dd570fe10025 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:12.657131 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc4caa-a00b-4d3a-bf24-dd570fe10025 None admin] RBAC: Adding query filter params (name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:12.657434 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc4caa-a00b-4d3a-bf24-dd570fe10025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:12.658856 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc4caa-a00b-4d3a-bf24-dd570fe10025 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:12.668972 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 294/587] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Jul 26 10:14:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:12.675909 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8310dce-3a11-41af-81ca-cb939d8ebfd5 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:12.728367 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:12.786135 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8310dce-3a11-41af-81ca-cb939d8ebfd5 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:12.822158 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482f912-64d5-4440-84c8-ae581fbbff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:12.822841 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482f912-64d5-4440-84c8-ae581fbbff3b None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:12.823251 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482f912-64d5-4440-84c8-ae581fbbff3b None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:12.823524 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482f912-64d5-4440-84c8-ae581fbbff3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:12.833948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482f912-64d5-4440-84c8-ae581fbbff3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:12.835506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482f912-64d5-4440-84c8-ae581fbbff3b None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:12.850514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-e482f912-64d5-4440-84c8-ae581fbbff3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:12.850514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:12.850514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:12.850514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:12.850514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:12.850514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:12.850514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:12.850514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:12.850514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:12.850514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:12.850514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:12.850514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:12.850514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:12.850514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:12.850514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:12.851450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:12.852335 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:12.852335 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:12.852335 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:12.852335 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:12.852335 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 294/588] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:12.858540 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc4caa-a00b-4d3a-bf24-dd570fe10025 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:12.935979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fa4bf-86ff-4a38-b3d2-5ed7dd3d52ba None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:12.936334 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fa4bf-86ff-4a38-b3d2-5ed7dd3d52ba None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:12.936526 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fa4bf-86ff-4a38-b3d2-5ed7dd3d52ba None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:12.938204 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 295/589] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:12.943361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86db298-654a-4ad0-a0e2-6a85f8e7e06c None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:12.943626 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86db298-654a-4ad0-a0e2-6a85f8e7e06c None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:12.943895 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86db298-654a-4ad0-a0e2-6a85f8e7e06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:12.962541 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-b86db298-654a-4ad0-a0e2-6a85f8e7e06c None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:12.963730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-b86db298-654a-4ad0-a0e2-6a85f8e7e06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:12.974203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc4caa-a00b-4d3a-bf24-dd570fe10025 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:13.021412 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b089c72-2053-4d2b-8d71-be01d34ae907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:13.022487 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b089c72-2053-4d2b-8d71-be01d34ae907 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:13.022839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b089c72-2053-4d2b-8d71-be01d34ae907 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:13.023432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b089c72-2053-4d2b-8d71-be01d34ae907 None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.024281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b089c72-2053-4d2b-8d71-be01d34ae907 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:13.024657 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b089c72-2053-4d2b-8d71-be01d34ae907 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:13.026769 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b089c72-2053-4d2b-8d71-be01d34ae907 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:13.046514 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 295/590] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:13.049688 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b089c72-2053-4d2b-8d71-be01d34ae907 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:13.066651 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 296/591] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:14:13.082577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86db298-654a-4ad0-a0e2-6a85f8e7e06c None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:13.093275 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:13.113797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:13.192194 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b089c72-2053-4d2b-8d71-be01d34ae907 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:13.196073 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86db298-654a-4ad0-a0e2-6a85f8e7e06c None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:13.233275 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092c1d6-40b1-4ad2-874c-fe596b89073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:13.233923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092c1d6-40b1-4ad2-874c-fe596b89073a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:13.234193 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092c1d6-40b1-4ad2-874c-fe596b89073a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:13.234586 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092c1d6-40b1-4ad2-874c-fe596b89073a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.240892 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371bd5c-1aac-43fd-b73f-d023dfba7318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:13.242321 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371bd5c-1aac-43fd-b73f-d023dfba7318 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:13.242917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371bd5c-1aac-43fd-b73f-d023dfba7318 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:13.243327 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371bd5c-1aac-43fd-b73f-d023dfba7318 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.248331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092c1d6-40b1-4ad2-874c-fe596b89073a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:13.252482 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371bd5c-1aac-43fd-b73f-d023dfba7318 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-c092c1d6-40b1-4ad2-874c-fe596b89073a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:13.253522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:13.254716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:13.255756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:13.255756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:13.255756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:13.255756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:13.255756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:13.255756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:13.255756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:13.255756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:13.255756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:13.255756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:13.255756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:13.255756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:13.257221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371bd5c-1aac-43fd-b73f-d023dfba7318 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:13.262599 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 297/592] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:14:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:13.264052 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092c1d6-40b1-4ad2-874c-fe596b89073a None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-7371bd5c-1aac-43fd-b73f-d023dfba7318 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:13.274292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:13.275499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:13.276720 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:13.276720 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:13.276720 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:13.276720 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:13.276720 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:13.276720 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:13.276720 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:13.276720 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:13.276720 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:14:13.276720 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:13.284311 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 296/593] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Jul 26 10:14:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:13.285078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371bd5c-1aac-43fd-b73f-d023dfba7318 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:13.365432 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:13.379421 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092c1d6-40b1-4ad2-874c-fe596b89073a None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:13.391268 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:13.398619 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371bd5c-1aac-43fd-b73f-d023dfba7318 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:13.422855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59014c2f-ea57-4da7-b548-d7da2b78fa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:13.423479 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59014c2f-ea57-4da7-b548-d7da2b78fa26 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:13.423753 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59014c2f-ea57-4da7-b548-d7da2b78fa26 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:13.424023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59014c2f-ea57-4da7-b548-d7da2b78fa26 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.424741 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59014c2f-ea57-4da7-b548-d7da2b78fa26 None admin] RBAC: Adding query filter params (name=service) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:13.425038 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59014c2f-ea57-4da7-b548-d7da2b78fa26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:13.426423 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59014c2f-ea57-4da7-b548-d7da2b78fa26 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:13.437684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aed775-bac5-430d-bd2d-51d2348e7717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:13.438703 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aed775-bac5-430d-bd2d-51d2348e7717 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:13.439182 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aed775-bac5-430d-bd2d-51d2348e7717 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:13.439646 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aed775-bac5-430d-bd2d-51d2348e7717 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.439997 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 298/594] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Jul 26 10:14:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:13.440910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aed775-bac5-430d-bd2d-51d2348e7717 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:13.441351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59014c2f-ea57-4da7-b548-d7da2b78fa26 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:13.441637 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aed775-bac5-430d-bd2d-51d2348e7717 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:13.443361 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aed775-bac5-430d-bd2d-51d2348e7717 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:13.466577 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 297/595] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Jul 26 10:14:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:13.469629 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aed775-bac5-430d-bd2d-51d2348e7717 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:13.550081 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59014c2f-ea57-4da7-b548-d7da2b78fa26 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:13.577833 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aed775-bac5-430d-bd2d-51d2348e7717 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:13.584422 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c53bf2-777a-41a0-9a07-d90714fab43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:13.585081 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c53bf2-777a-41a0-9a07-d90714fab43a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:13.585354 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c53bf2-777a-41a0-9a07-d90714fab43a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:13.585695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c53bf2-777a-41a0-9a07-d90714fab43a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.597567 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c53bf2-777a-41a0-9a07-d90714fab43a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:13.599082 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c53bf2-777a-41a0-9a07-d90714fab43a None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:13.614674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-f6c53bf2-777a-41a0-9a07-d90714fab43a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:13.614674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:13.614674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:13.614674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:13.614674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:13.614674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:13.614674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:13.614674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:13.614674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:13.614674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:13.614674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:13.614674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:13.614674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:13.614674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:13.614674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:13.615650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:13.616699 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:13.616699 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:13.616699 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:13.616699 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:13.620843 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 299/596] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:13.622605 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c53bf2-777a-41a0-9a07-d90714fab43a None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:13.622924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5de69-eb33-44be-a0e0-6c0416735bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:13.623824 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5de69-eb33-44be-a0e0-6c0416735bfe None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:13.624344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5de69-eb33-44be-a0e0-6c0416735bfe None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:13.624807 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5de69-eb33-44be-a0e0-6c0416735bfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.625551 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:13.658622 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:13.708954 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5de69-eb33-44be-a0e0-6c0416735bfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:13.710481 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5de69-eb33-44be-a0e0-6c0416735bfe None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:13.736517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c53bf2-777a-41a0-9a07-d90714fab43a None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:13.771845 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d524b-ff61-4ccf-b08f-46a027c748cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:13.772448 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d524b-ff61-4ccf-b08f-46a027c748cd None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:13.772845 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d524b-ff61-4ccf-b08f-46a027c748cd None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:13.773095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d524b-ff61-4ccf-b08f-46a027c748cd None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.773821 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d524b-ff61-4ccf-b08f-46a027c748cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:13.774108 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d524b-ff61-4ccf-b08f-46a027c748cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:13.775526 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d524b-ff61-4ccf-b08f-46a027c748cd None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:13.789508 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 300/597] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:13.790935 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bdc1f-994a-4fc5-8596-40c91c337cb7 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:13.791243 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bdc1f-994a-4fc5-8596-40c91c337cb7 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:13.791401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bdc1f-994a-4fc5-8596-40c91c337cb7 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.792799 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 301/598] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:13.793841 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268fee1-06c2-457a-addd-76496cddbc82 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:13.794010 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268fee1-06c2-457a-addd-76496cddbc82 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:13.794288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268fee1-06c2-457a-addd-76496cddbc82 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.795498 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 302/599] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:13.796204 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268fee1-06c2-457a-addd-76496cddbc82 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:13.825128 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 298/600] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:14:13.826492 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8fc60-9d83-46ba-b8ab-fb013299e184 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:13.826780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8fc60-9d83-46ba-b8ab-fb013299e184 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:13.827108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8fc60-9d83-46ba-b8ab-fb013299e184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.845971 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-91a8fc60-9d83-46ba-b8ab-fb013299e184 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:13.847186 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-91a8fc60-9d83-46ba-b8ab-fb013299e184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:13.862803 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:13.896394 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:13.904247 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268fee1-06c2-457a-addd-76496cddbc82 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:13.916361 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 299/601] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:14:13.917616 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8750e2-97fb-4df4-8461-343fcd9b54a3 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:13.917895 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8750e2-97fb-4df4-8461-343fcd9b54a3 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:13.918194 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8750e2-97fb-4df4-8461-343fcd9b54a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.936982 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-9f8750e2-97fb-4df4-8461-343fcd9b54a3 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:13.938465 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-9f8750e2-97fb-4df4-8461-343fcd9b54a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:13.941247 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883f754-e6ad-4065-b70d-33228ad34fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:13.941896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883f754-e6ad-4065-b70d-33228ad34fd0 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:13.942170 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883f754-e6ad-4065-b70d-33228ad34fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:13.942457 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883f754-e6ad-4065-b70d-33228ad34fd0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.950164 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883f754-e6ad-4065-b70d-33228ad34fd0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:13.951798 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883f754-e6ad-4065-b70d-33228ad34fd0 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-a883f754-e6ad-4065-b70d-33228ad34fd0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:13.969769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:13.970902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:13.972276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:13.972276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:13.972276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:13.972276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:13.972276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:13.972276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:13.972276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:13.972276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:13.972276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 10:14:13.972276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:13.972276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 303/602] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:13.972276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883f754-e6ad-4065-b70d-33228ad34fd0 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:14.014327 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 300/603] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:14:14.015377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8750e2-97fb-4df4-8461-343fcd9b54a3 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:14.085948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883f754-e6ad-4065-b70d-33228ad34fd0 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:14.108488 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:14.117122 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8750e2-97fb-4df4-8461-343fcd9b54a3 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:14.120680 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e5994-5f0f-43ba-a388-27bac304f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:14.121402 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e5994-5f0f-43ba-a388-27bac304f132 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:14.121680 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e5994-5f0f-43ba-a388-27bac304f132 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:14.121949 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e5994-5f0f-43ba-a388-27bac304f132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:14.131443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:14.132678 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e5994-5f0f-43ba-a388-27bac304f132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:14.134326 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e5994-5f0f-43ba-a388-27bac304f132 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:14.148719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-958e5994-5f0f-43ba-a388-27bac304f132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:14.148719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:14.148719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:14.148719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:14.148719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:14.148719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:14.148719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:14.148719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:14.148719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:14.148719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:14.148719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:14.148719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:14.148719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:14.148719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:14.148719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:14.149642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:14.150602 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:14.150602 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:14.150602 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:14.150602 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:14.150602 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 304/604] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:14.150877 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e5994-5f0f-43ba-a388-27bac304f132 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:14.156690 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664f782-e267-4517-9131-ed5dad8f34d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:14.157336 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664f782-e267-4517-9131-ed5dad8f34d8 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:14.157607 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664f782-e267-4517-9131-ed5dad8f34d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:14.158632 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664f782-e267-4517-9131-ed5dad8f34d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:14.168568 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664f782-e267-4517-9131-ed5dad8f34d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-a664f782-e267-4517-9131-ed5dad8f34d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:14.173432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:14.174551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:14.175523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:14.175523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:14.175523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:14.175523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:14.175523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:14.175523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:14.175523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:14.175523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:14.175523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:14.175523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:14.175523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:14.175523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:14.175523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 301/605] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:14:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:14.175523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664f782-e267-4517-9131-ed5dad8f34d8 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:14.256506 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e5994-5f0f-43ba-a388-27bac304f132 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:14.283533 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664f782-e267-4517-9131-ed5dad8f34d8 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:14.291265 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa307ad-86ad-4d8a-aa73-c5341ca6a8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:14.291885 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa307ad-86ad-4d8a-aa73-c5341ca6a8a4 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:14.292158 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa307ad-86ad-4d8a-aa73-c5341ca6a8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:14.292430 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa307ad-86ad-4d8a-aa73-c5341ca6a8a4 None admin] PATH_INFO: `/v3/users` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:14.293301 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa307ad-86ad-4d8a-aa73-c5341ca6a8a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:14.293586 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa307ad-86ad-4d8a-aa73-c5341ca6a8a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:14.295105 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa307ad-86ad-4d8a-aa73-c5341ca6a8a4 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:14.312137 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 305/606] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Jul 26 10:14:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:14.312957 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa307ad-86ad-4d8a-aa73-c5341ca6a8a4 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:14.320980 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb793ec5-cf01-4352-8f17-4875d051effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:14.322050 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb793ec5-cf01-4352-8f17-4875d051effc None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:14.322336 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb793ec5-cf01-4352-8f17-4875d051effc None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:14.322640 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb793ec5-cf01-4352-8f17-4875d051effc None admin] PATH_INFO: `/v3/roles/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:14.333059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb793ec5-cf01-4352-8f17-4875d051effc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-bb793ec5-cf01-4352-8f17-4875d051effc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:14.337915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:14.338914 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:14.339778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:14.339778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:14.339778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:14.339778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:14.339778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:14.339778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:14.339778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:14.339778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:14.339778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:14.339778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:14.339778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:14:14.339778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:14.339778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 302/607] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:14:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:14.340472 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb793ec5-cf01-4352-8f17-4875d051effc None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:14.347298 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:14.377248 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:14.424274 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa307ad-86ad-4d8a-aa73-c5341ca6a8a4 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:14.445162 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb793ec5-cf01-4352-8f17-4875d051effc None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:14.457593 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c596f1-dc13-41a5-bb35-a456c2b882f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:14.458220 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c596f1-dc13-41a5-bb35-a456c2b882f1 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:14.458531 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c596f1-dc13-41a5-bb35-a456c2b882f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:14.458804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c596f1-dc13-41a5-bb35-a456c2b882f1 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:14.459499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c596f1-dc13-41a5-bb35-a456c2b882f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:14.459801 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c596f1-dc13-41a5-bb35-a456c2b882f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:14.461215 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c596f1-dc13-41a5-bb35-a456c2b882f1 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:14.472714 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 306/608] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:14.473344 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c596f1-dc13-41a5-bb35-a456c2b882f1 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:14.479792 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149ca77-1829-4f14-9ff1-5167655d2701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:14.480478 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149ca77-1829-4f14-9ff1-5167655d2701 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:14.480761 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149ca77-1829-4f14-9ff1-5167655d2701 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:14.481044 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149ca77-1829-4f14-9ff1-5167655d2701 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:14.481765 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149ca77-1829-4f14-9ff1-5167655d2701 None admin] RBAC: Adding query filter params (name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:14.482075 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149ca77-1829-4f14-9ff1-5167655d2701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:14.483482 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149ca77-1829-4f14-9ff1-5167655d2701 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:14.491927 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 303/609] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Jul 26 10:14:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:14.492766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149ca77-1829-4f14-9ff1-5167655d2701 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:14.568188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:14.577200 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c596f1-dc13-41a5-bb35-a456c2b882f1 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:14.590382 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:14.596305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149ca77-1829-4f14-9ff1-5167655d2701 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:14.616628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e53448-4073-4ff7-91d8-39d1eccd3850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:14.617258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e53448-4073-4ff7-91d8-39d1eccd3850 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:14.617534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e53448-4073-4ff7-91d8-39d1eccd3850 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:14.617804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e53448-4073-4ff7-91d8-39d1eccd3850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:14.631543 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acecba-716f-4030-a96c-a33d58205bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:14.632178 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acecba-716f-4030-a96c-a33d58205bf8 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:14.632449 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acecba-716f-4030-a96c-a33d58205bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:14.632718 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acecba-716f-4030-a96c-a33d58205bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:14.633470 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acecba-716f-4030-a96c-a33d58205bf8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:14.633773 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acecba-716f-4030-a96c-a33d58205bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:14.635179 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acecba-716f-4030-a96c-a33d58205bf8 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:14.643431 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 304/610] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Jul 26 10:14:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:14.644230 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acecba-716f-4030-a96c-a33d58205bf8 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:14.686801 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e53448-4073-4ff7-91d8-39d1eccd3850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:14.688297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e53448-4073-4ff7-91d8-39d1eccd3850 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:14.748719 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acecba-716f-4030-a96c-a33d58205bf8 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:14.783002 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:14.784162 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bc230-2150-4a0e-ab24-a90feecd1c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:14.784786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bc230-2150-4a0e-ab24-a90feecd1c26 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:14.785056 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bc230-2150-4a0e-ab24-a90feecd1c26 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:14.785323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bc230-2150-4a0e-ab24-a90feecd1c26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:14.793315 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bc230-2150-4a0e-ab24-a90feecd1c26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:14.794824 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bc230-2150-4a0e-ab24-a90feecd1c26 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:14.795712 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 307/611] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:14:14.796539 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e53448-4073-4ff7-91d8-39d1eccd3850 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:14.807357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-fa5bc230-2150-4a0e-ab24-a90feecd1c26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:14.807357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:14.807357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:14.807357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:14.807357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:14.807357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:14.807357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:14.807357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:14.807357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:14.807357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:14.807357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:14.807357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:14.807357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:14.807357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:14.807357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:14.808344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:14.809407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:14.809407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:14.809407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:14.809407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:14.809407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:14.809407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:14.809407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:14.809407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:14.809407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 305/612] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:14.809921 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bc230-2150-4a0e-ab24-a90feecd1c26 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:14.833526 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:14.901882 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e53448-4073-4ff7-91d8-39d1eccd3850 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:14.917300 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bc230-2150-4a0e-ab24-a90feecd1c26 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:14.938692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881145e-d5ec-4cf3-9871-684c8aef16c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:14.939379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881145e-d5ec-4cf3-9871-684c8aef16c9 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:14.939647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881145e-d5ec-4cf3-9871-684c8aef16c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:14.939900 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881145e-d5ec-4cf3-9871-684c8aef16c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:14.950743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881145e-d5ec-4cf3-9871-684c8aef16c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:14.952295 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881145e-d5ec-4cf3-9871-684c8aef16c9 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:14.954256 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb137dc-4fcc-49c7-a4dd-0359f4b93e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:14.954945 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb137dc-4fcc-49c7-a4dd-0359f4b93e4d None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:14.955229 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb137dc-4fcc-49c7-a4dd-0359f4b93e4d None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:14.955506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb137dc-4fcc-49c7-a4dd-0359f4b93e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:14.966752 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb137dc-4fcc-49c7-a4dd-0359f4b93e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:14.968017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-f881145e-d5ec-4cf3-9871-684c8aef16c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:14.968017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:14.968017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:14.968017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:14.968017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:14.968017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:14.968017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:14.968017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:14.968017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:14.968017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:14.968017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:14.968017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:14.968017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:14.968017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:14.968017 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:14.969063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:14.970037 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:14.970037 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:14.970037 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:14.970037 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:14.970272 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb137dc-4fcc-49c7-a4dd-0359f4b93e4d None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:14.970343 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 308/613] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:14.970343 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881145e-d5ec-4cf3-9871-684c8aef16c9 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:14.987468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-7bb137dc-4fcc-49c7-a4dd-0359f4b93e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:14.987468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:14.987468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:14.987468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:14.987468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:14.987468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:14.987468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:14.987468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:14.987468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:14.987468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:14.987468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:14.987468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:14.987468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:14.987468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:14.987468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:14.988529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:14.989483 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:14.989483 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:14.989483 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:14.989483 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:14.989483 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 306/614] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:14.989483 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb137dc-4fcc-49c7-a4dd-0359f4b93e4d None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:15.023131 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:15.061682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:15.081490 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881145e-d5ec-4cf3-9871-684c8aef16c9 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:15.093999 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb137dc-4fcc-49c7-a4dd-0359f4b93e4d None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:15.115813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e7c90-78ca-422d-921a-981df1a9e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:15.116546 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e7c90-78ca-422d-921a-981df1a9e977 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.116888 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e7c90-78ca-422d-921a-981df1a9e977 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.117228 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e7c90-78ca-422d-921a-981df1a9e977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.127745 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e7c90-78ca-422d-921a-981df1a9e977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:15.128662 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6e3c7-4d23-42b6-8f89-0cdb2181e930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:15.129296 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e7c90-78ca-422d-921a-981df1a9e977 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:15.129454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6e3c7-4d23-42b6-8f89-0cdb2181e930 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.129581 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6e3c7-4d23-42b6-8f89-0cdb2181e930 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.129854 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6e3c7-4d23-42b6-8f89-0cdb2181e930 None admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.130635 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6e3c7-4d23-42b6-8f89-0cdb2181e930 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:15.130943 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6e3c7-4d23-42b6-8f89-0cdb2181e930 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:15.132360 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6e3c7-4d23-42b6-8f89-0cdb2181e930 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:15.144381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-b30e7c90-78ca-422d-921a-981df1a9e977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:15.144381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:15.144381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:15.144381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:15.144381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:15.144381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:15.144381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:15.144381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:15.144381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:15.144381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:15.144381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:15.144381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:15.144381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:15.144381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:15.144381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:15.145407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:15.146311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:15.146311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:15.146311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:15.146311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:15.146570 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 307/615] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:14:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:15.146655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 309/616] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:15.146655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e7c90-78ca-422d-921a-981df1a9e977 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:15.151227 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6e3c7-4d23-42b6-8f89-0cdb2181e930 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:15.241283 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:15.248065 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e7c90-78ca-422d-921a-981df1a9e977 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:15.250452 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6e3c7-4d23-42b6-8f89-0cdb2181e930 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:15.279235 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:15.282904 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0413bb-404d-44a4-bfd9-29e3a2132918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:15.283539 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0413bb-404d-44a4-bfd9-29e3a2132918 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.283821 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0413bb-404d-44a4-bfd9-29e3a2132918 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.284095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0413bb-404d-44a4-bfd9-29e3a2132918 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.284793 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0413bb-404d-44a4-bfd9-29e3a2132918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:15.285099 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0413bb-404d-44a4-bfd9-29e3a2132918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:15.285854 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3dc9f-6e6e-4120-8f36-f7849d7da5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:15.286508 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3dc9f-6e6e-4120-8f36-f7849d7da5e9 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.286615 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0413bb-404d-44a4-bfd9-29e3a2132918 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:15.286790 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3dc9f-6e6e-4120-8f36-f7849d7da5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.287063 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3dc9f-6e6e-4120-8f36-f7849d7da5e9 None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.288124 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3dc9f-6e6e-4120-8f36-f7849d7da5e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:15.288426 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3dc9f-6e6e-4120-8f36-f7849d7da5e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:15.289782 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3dc9f-6e6e-4120-8f36-f7849d7da5e9 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:15.299676 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 310/617] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:15.300567 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0413bb-404d-44a4-bfd9-29e3a2132918 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:15.301180 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 308/618] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:15.301964 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3dc9f-6e6e-4120-8f36-f7849d7da5e9 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:15.398005 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0413bb-404d-44a4-bfd9-29e3a2132918 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:15.402828 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3dc9f-6e6e-4120-8f36-f7849d7da5e9 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:15.441501 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed31784-660a-48b9-bd41-785074feefde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:15.442190 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed31784-660a-48b9-bd41-785074feefde None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.442502 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed31784-660a-48b9-bd41-785074feefde None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.442827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed31784-660a-48b9-bd41-785074feefde None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.443532 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed31784-660a-48b9-bd41-785074feefde None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:15.443726 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49570a9-1feb-434c-8999-20ce51c6e3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:15.443836 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed31784-660a-48b9-bd41-785074feefde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:15.444345 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49570a9-1feb-434c-8999-20ce51c6e3fa None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.444616 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49570a9-1feb-434c-8999-20ce51c6e3fa None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.444878 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49570a9-1feb-434c-8999-20ce51c6e3fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.445210 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed31784-660a-48b9-bd41-785074feefde None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:15.445664 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49570a9-1feb-434c-8999-20ce51c6e3fa None admin] RBAC: Adding query filter params (role.id=81782254e8c2428284b8181e87647f8a, scope.project.id=6897068dc29445f7878c7c12a0915d48, user.id=d68b323bc2b54984ad2ed0d248675624) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:15.445964 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49570a9-1feb-434c-8999-20ce51c6e3fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:15.447418 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49570a9-1feb-434c-8999-20ce51c6e3fa None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:15.453409 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 311/619] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:14:15 2022] GET /identity/v3/role_assignments?user.id=d68b323bc2b54984ad2ed0d248675624&scope.project.id=6897068dc29445f7878c7c12a0915d48&role.id=81782254e8c2428284b8181e87647f8a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:15.454216 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49570a9-1feb-434c-8999-20ce51c6e3fa None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:15.463045 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 309/620] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:15.463792 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed31784-660a-48b9-bd41-785074feefde None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:15.485771 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:15.525106 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:15.580459 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed31784-660a-48b9-bd41-785074feefde None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:15.588010 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49570a9-1feb-434c-8999-20ce51c6e3fa None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:15.627200 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efe4da-1825-4cf1-8581-b092b3833c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:15.627951 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efe4da-1825-4cf1-8581-b092b3833c0c None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.628236 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efe4da-1825-4cf1-8581-b092b3833c0c None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.628541 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efe4da-1825-4cf1-8581-b092b3833c0c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.629933 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab439d78-3e18-4fc4-9de0-85f7b9ba1477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:15.630701 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab439d78-3e18-4fc4-9de0-85f7b9ba1477 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.630978 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab439d78-3e18-4fc4-9de0-85f7b9ba1477 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.631248 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab439d78-3e18-4fc4-9de0-85f7b9ba1477 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.636829 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efe4da-1825-4cf1-8581-b092b3833c0c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:15.638291 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efe4da-1825-4cf1-8581-b092b3833c0c None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:15.640433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab439d78-3e18-4fc4-9de0-85f7b9ba1477 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:15.641877 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab439d78-3e18-4fc4-9de0-85f7b9ba1477 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-ab439d78-3e18-4fc4-9de0-85f7b9ba1477 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:15.654371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:15.655522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:15.656674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:15.656674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:15.656674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:15.656674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:15.656674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:15.656674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:15.656674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:15.656674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:15.656674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:14:15.656674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:15.656674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 312/621] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-88efe4da-1825-4cf1-8581-b092b3833c0c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:15.657432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:15.658377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:15.659634 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:15.659634 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:15.659634 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:15.659634 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:15.659634 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:15.659634 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:15.659634 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:15.659634 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:15.659634 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 10:14:15.659634 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:15.661080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab439d78-3e18-4fc4-9de0-85f7b9ba1477 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:15.663657 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 310/622] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:14:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:15.663657 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efe4da-1825-4cf1-8581-b092b3833c0c None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:15.751347 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:15.772886 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab439d78-3e18-4fc4-9de0-85f7b9ba1477 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:15.775239 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efe4da-1825-4cf1-8581-b092b3833c0c None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:15.786567 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:15.809015 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a40ed-6065-40c7-a090-9c91c29c140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:15.809781 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a40ed-6065-40c7-a090-9c91c29c140a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.810127 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a40ed-6065-40c7-a090-9c91c29c140a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.810407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a40ed-6065-40c7-a090-9c91c29c140a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.812563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81599d03-22f1-43f4-b821-e8b59ae69e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:15.813196 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81599d03-22f1-43f4-b821-e8b59ae69e68 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.813479 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81599d03-22f1-43f4-b821-e8b59ae69e68 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.813762 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81599d03-22f1-43f4-b821-e8b59ae69e68 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.814599 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81599d03-22f1-43f4-b821-e8b59ae69e68 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:15.814910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81599d03-22f1-43f4-b821-e8b59ae69e68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:15.816359 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81599d03-22f1-43f4-b821-e8b59ae69e68 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:15.818075 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a40ed-6065-40c7-a090-9c91c29c140a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:15.819540 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a40ed-6065-40c7-a090-9c91c29c140a None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:15.831311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-499a40ed-6065-40c7-a090-9c91c29c140a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:15.831311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:15.831311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:15.831311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:15.831311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:15.831311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:15.831311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:15.831311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:15.831311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:15.831311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:15.831311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:15.831311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:15.831311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:15.831311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:15.831311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:15.832287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:15.833198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:15.833198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:15.833198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:15.833198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:15.833198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:15.833198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:15.833198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:15.833198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:15.833198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 313/623] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:15.833711 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a40ed-6065-40c7-a090-9c91c29c140a None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:15.840187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 311/624] 10.222.0.60 () {56 vars in 1139 bytes} [Tue Jul 26 10:14:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:15.841303 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81599d03-22f1-43f4-b821-e8b59ae69e68 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:15.944168 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a40ed-6065-40c7-a090-9c91c29c140a None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:15.949536 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81599d03-22f1-43f4-b821-e8b59ae69e68 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:15.981312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26ddd2-7d50-4d5f-9fc3-912ed2fb1822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:15.982022 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26ddd2-7d50-4d5f-9fc3-912ed2fb1822 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.982365 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26ddd2-7d50-4d5f-9fc3-912ed2fb1822 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.982757 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26ddd2-7d50-4d5f-9fc3-912ed2fb1822 None admin] PATH_INFO: `/v3/users` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.983453 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26ddd2-7d50-4d5f-9fc3-912ed2fb1822 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:15.983753 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26ddd2-7d50-4d5f-9fc3-912ed2fb1822 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:15.984372 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b0f42-97f1-4045-a16f-3b331ae4997e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:15.984997 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b0f42-97f1-4045-a16f-3b331ae4997e None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.985187 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26ddd2-7d50-4d5f-9fc3-912ed2fb1822 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:15.985284 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b0f42-97f1-4045-a16f-3b331ae4997e None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.985534 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b0f42-97f1-4045-a16f-3b331ae4997e None admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.986297 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b0f42-97f1-4045-a16f-3b331ae4997e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:15.986659 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b0f42-97f1-4045-a16f-3b331ae4997e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:15.988285 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b0f42-97f1-4045-a16f-3b331ae4997e None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:15.994707 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:16.004581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 314/625] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Jul 26 10:14:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:16.005694 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 312/626] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:14:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:16.005971 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26ddd2-7d50-4d5f-9fc3-912ed2fb1822 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:16.009798 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b0f42-97f1-4045-a16f-3b331ae4997e None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:16.051280 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:16.112976 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26ddd2-7d50-4d5f-9fc3-912ed2fb1822 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:16.127116 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b0f42-97f1-4045-a16f-3b331ae4997e None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:16.147590 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a654a9-92fb-49f3-a37d-c31f82961ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:16.148216 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a654a9-92fb-49f3-a37d-c31f82961ff1 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:16.148495 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a654a9-92fb-49f3-a37d-c31f82961ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:16.148777 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a654a9-92fb-49f3-a37d-c31f82961ff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:16.162705 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fb60e-f049-4cce-b561-513104aba25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:16.163670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fb60e-f049-4cce-b561-513104aba25b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:16.164248 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fb60e-f049-4cce-b561-513104aba25b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:16.164522 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fb60e-f049-4cce-b561-513104aba25b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:16.219058 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:16.222787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a654a9-92fb-49f3-a37d-c31f82961ff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:16.224451 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a654a9-92fb-49f3-a37d-c31f82961ff1 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:16.236682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105fb60e-f049-4cce-b561-513104aba25b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:16.238281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105fb60e-f049-4cce-b561-513104aba25b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:16.268505 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:16.333614 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 315/627] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:14:16.335111 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a654a9-92fb-49f3-a37d-c31f82961ff1 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:16.354185 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 313/628] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:14:16.355868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fb60e-f049-4cce-b561-513104aba25b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:16.446748 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:16.451118 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a654a9-92fb-49f3-a37d-c31f82961ff1 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:16.464562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fb60e-f049-4cce-b561-513104aba25b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:16.487647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d9942-e899-4897-a588-bc0a571bf62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:16.488198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9942-e899-4897-a588-bc0a571bf62a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:16.488471 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9942-e899-4897-a588-bc0a571bf62a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:16.488798 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9942-e899-4897-a588-bc0a571bf62a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:16.489550 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d9942-e899-4897-a588-bc0a571bf62a None admin] RBAC: Adding query filter params (role.id=81782254e8c2428284b8181e87647f8a, scope.project.id=6897068dc29445f7878c7c12a0915d48, user.id=7f4adbb70e9f46f9a6a416329e8c0bf2) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:16.489854 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d9942-e899-4897-a588-bc0a571bf62a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:16.491321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d9942-e899-4897-a588-bc0a571bf62a None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:16.491646 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:16.497626 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 316/629] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:14:16 2022] GET /identity/v3/role_assignments?user.id=7f4adbb70e9f46f9a6a416329e8c0bf2&scope.project.id=6897068dc29445f7878c7c12a0915d48&role.id=81782254e8c2428284b8181e87647f8a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:16.498461 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d9942-e899-4897-a588-bc0a571bf62a None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:16.511236 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1cc95-7f33-456b-88d2-1e6f688c3480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:16.512255 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1cc95-7f33-456b-88d2-1e6f688c3480 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:16.512683 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1cc95-7f33-456b-88d2-1e6f688c3480 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:16.513123 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1cc95-7f33-456b-88d2-1e6f688c3480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:16.525887 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1cc95-7f33-456b-88d2-1e6f688c3480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:16.527984 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1cc95-7f33-456b-88d2-1e6f688c3480 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:16.546864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-acb1cc95-7f33-456b-88d2-1e6f688c3480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:16.546864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:16.546864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:16.546864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:16.546864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:16.546864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:16.546864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:16.546864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:16.546864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:16.546864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:16.546864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:16.546864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:16.546864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:16.546864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:16.546864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:16.547936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:16.548923 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:16.548923 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:16.548923 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:16.548923 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:16.555909 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 314/630] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:16.557326 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1cc95-7f33-456b-88d2-1e6f688c3480 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:16.651263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d9942-e899-4897-a588-bc0a571bf62a None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:16.696263 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1cc95-7f33-456b-88d2-1e6f688c3480 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:16.713042 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248e572-df7c-4c22-b631-44cccfa6847f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:16.713858 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248e572-df7c-4c22-b631-44cccfa6847f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:16.714685 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248e572-df7c-4c22-b631-44cccfa6847f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:16.716039 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248e572-df7c-4c22-b631-44cccfa6847f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:16.732029 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248e572-df7c-4c22-b631-44cccfa6847f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:16.734903 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248e572-df7c-4c22-b631-44cccfa6847f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:16.739770 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ef434-6444-4b5c-8dbd-c7c5e2954586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:16.742334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ef434-6444-4b5c-8dbd-c7c5e2954586 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:16.742886 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ef434-6444-4b5c-8dbd-c7c5e2954586 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:16.743379 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ef434-6444-4b5c-8dbd-c7c5e2954586 None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:16.744111 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ef434-6444-4b5c-8dbd-c7c5e2954586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:16.744416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ef434-6444-4b5c-8dbd-c7c5e2954586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:16.745842 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ef434-6444-4b5c-8dbd-c7c5e2954586 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:16.755297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-f248e572-df7c-4c22-b631-44cccfa6847f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:16.755297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:16.755297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:16.755297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:16.755297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:16.755297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:16.755297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:16.755297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:16.755297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:16.755297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:16.755297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:16.755297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:16.755297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:16.755297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:16.755297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:16.756683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:16.758312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:16.758312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:16.758312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:16.758312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:16.758312 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 317/631] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:16.760058 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 315/632] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:16.763612 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248e572-df7c-4c22-b631-44cccfa6847f None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:16.766988 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ef434-6444-4b5c-8dbd-c7c5e2954586 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:16.784231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:16.827056 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:16.898165 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248e572-df7c-4c22-b631-44cccfa6847f None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:16.908544 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ef434-6444-4b5c-8dbd-c7c5e2954586 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:16.937003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23c4b6-bceb-46d6-a846-bc50b2806844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:16.937896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23c4b6-bceb-46d6-a846-bc50b2806844 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:16.938350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23c4b6-bceb-46d6-a846-bc50b2806844 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:16.938800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23c4b6-bceb-46d6-a846-bc50b2806844 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:16.939714 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23c4b6-bceb-46d6-a846-bc50b2806844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:16.940235 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23c4b6-bceb-46d6-a846-bc50b2806844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:16.941845 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23c4b6-bceb-46d6-a846-bc50b2806844 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:16.956087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43836ce3-fd62-4ee3-8948-6d4593824887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:16.956751 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43836ce3-fd62-4ee3-8948-6d4593824887 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:16.957158 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43836ce3-fd62-4ee3-8948-6d4593824887 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:16.957350 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43836ce3-fd62-4ee3-8948-6d4593824887 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:16.957760 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 318/633] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:16.965787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23c4b6-bceb-46d6-a846-bc50b2806844 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:16.965987 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43836ce3-fd62-4ee3-8948-6d4593824887 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:16.968431 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43836ce3-fd62-4ee3-8948-6d4593824887 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:16.981939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-43836ce3-fd62-4ee3-8948-6d4593824887 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:16.981939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:16.981939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:16.981939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:16.981939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:16.981939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:16.981939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:16.981939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:16.981939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:16.981939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:16.981939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:16.981939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:16.981939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:16.981939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:16.981939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:16.983120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:16.984133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:16.984133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:16.984133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:16.984133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:16.984133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:16.984133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:16.984133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:16.984133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:16.991089 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 316/634] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:16.992294 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43836ce3-fd62-4ee3-8948-6d4593824887 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:17.061594 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:17.099227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23c4b6-bceb-46d6-a846-bc50b2806844 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:17.119527 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:17.123869 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43836ce3-fd62-4ee3-8948-6d4593824887 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:17.148257 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2f67c-dff0-4c89-84ff-937bff84eca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:17.149508 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2f67c-dff0-4c89-84ff-937bff84eca4 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:17.149793 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2f67c-dff0-4c89-84ff-937bff84eca4 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:17.150068 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2f67c-dff0-4c89-84ff-937bff84eca4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:17.166742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2f67c-dff0-4c89-84ff-937bff84eca4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:17.169313 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2f67c-dff0-4c89-84ff-937bff84eca4 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:17.177589 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e4d1c-a99d-4d68-99ea-a0aaa7f2ea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:17.178229 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e4d1c-a99d-4d68-99ea-a0aaa7f2ea38 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:17.178601 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e4d1c-a99d-4d68-99ea-a0aaa7f2ea38 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:17.178876 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e4d1c-a99d-4d68-99ea-a0aaa7f2ea38 None admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:17.179704 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e4d1c-a99d-4d68-99ea-a0aaa7f2ea38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:17.180016 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e4d1c-a99d-4d68-99ea-a0aaa7f2ea38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:17.181495 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e4d1c-a99d-4d68-99ea-a0aaa7f2ea38 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:17.187695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-40d2f67c-dff0-4c89-84ff-937bff84eca4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:17.187695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:17.187695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:17.187695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:17.187695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:17.187695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:17.187695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:17.187695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:17.187695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:17.187695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:17.187695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:17.187695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:17.187695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:17.187695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:17.187695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:17.188656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:17.189540 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:17.189540 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:17.189540 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:17.189540 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:17.189540 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:17.189540 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:17.189540 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:17.189540 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:17.189540 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 319/635] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:17.197246 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2f67c-dff0-4c89-84ff-937bff84eca4 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:17.206835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 317/636] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:14:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:17.208561 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e4d1c-a99d-4d68-99ea-a0aaa7f2ea38 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:17.326341 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e4d1c-a99d-4d68-99ea-a0aaa7f2ea38 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:17.331262 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2f67c-dff0-4c89-84ff-937bff84eca4 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:17.368059 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa08ce9-1581-4ff0-a15e-4e2766c16343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:17.368705 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa08ce9-1581-4ff0-a15e-4e2766c16343 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:17.368954 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa08ce9-1581-4ff0-a15e-4e2766c16343 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:17.369218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa08ce9-1581-4ff0-a15e-4e2766c16343 None admin] PATH_INFO: `/v3/projects` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:17.369993 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa08ce9-1581-4ff0-a15e-4e2766c16343 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:17.370297 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa08ce9-1581-4ff0-a15e-4e2766c16343 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:17.371853 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa08ce9-1581-4ff0-a15e-4e2766c16343 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:17.373783 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:17.374735 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f9117-78e0-4228-8907-32a9a0d7f58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:17.375371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f9117-78e0-4228-8907-32a9a0d7f58d None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:17.376065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f9117-78e0-4228-8907-32a9a0d7f58d None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:17.376342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f9117-78e0-4228-8907-32a9a0d7f58d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:17.377141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f9117-78e0-4228-8907-32a9a0d7f58d None admin] RBAC: Adding query filter params (role.id=81782254e8c2428284b8181e87647f8a, scope.project.id=6897068dc29445f7878c7c12a0915d48, user.id=c2ed2d73e1984404b8099b18a9bb7594) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:17.377454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f9117-78e0-4228-8907-32a9a0d7f58d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:17.378960 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f9117-78e0-4228-8907-32a9a0d7f58d None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:17.387762 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 318/637] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:14:17 2022] GET /identity/v3/role_assignments?user.id=c2ed2d73e1984404b8099b18a9bb7594&scope.project.id=6897068dc29445f7878c7c12a0915d48&role.id=81782254e8c2428284b8181e87647f8a => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:17.392450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 320/638] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:14:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:17.395577 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f9117-78e0-4228-8907-32a9a0d7f58d None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:17.432453 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:17.520103 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f9117-78e0-4228-8907-32a9a0d7f58d None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:17.562675 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4146ca-0d17-46d5-9ab9-1e9bbe80500c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:17.563315 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4146ca-0d17-46d5-9ab9-1e9bbe80500c None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:17.563594 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4146ca-0d17-46d5-9ab9-1e9bbe80500c None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:17.563864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4146ca-0d17-46d5-9ab9-1e9bbe80500c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:17.564683 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4146ca-0d17-46d5-9ab9-1e9bbe80500c None admin] RBAC: Adding query filter params (role.id=81782254e8c2428284b8181e87647f8a, scope.project.id=6897068dc29445f7878c7c12a0915d48, user.id=6a2272bbc60f47fc929b1cc352533f7e) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:17.564992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4146ca-0d17-46d5-9ab9-1e9bbe80500c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:17.566628 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4146ca-0d17-46d5-9ab9-1e9bbe80500c None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:17.574320 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 319/639] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:14:17 2022] GET /identity/v3/role_assignments?user.id=6a2272bbc60f47fc929b1cc352533f7e&scope.project.id=6897068dc29445f7878c7c12a0915d48&role.id=81782254e8c2428284b8181e87647f8a => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:17.799306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238411c6-bb10-4bde-a910-f2314645abaa None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:17.799589 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238411c6-bb10-4bde-a910-f2314645abaa None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:17.799853 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238411c6-bb10-4bde-a910-f2314645abaa None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:17.801464 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 321/640] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:17.806962 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8992ab3-0350-4d3b-beda-a69f50bef23b None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:17.807233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8992ab3-0350-4d3b-beda-a69f50bef23b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:17.807509 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8992ab3-0350-4d3b-beda-a69f50bef23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:17.826741 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-d8992ab3-0350-4d3b-beda-a69f50bef23b None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:17.827950 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-d8992ab3-0350-4d3b-beda-a69f50bef23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:17.899937 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 320/641] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:14:17.925071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238411c6-bb10-4bde-a910-f2314645abaa None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:18.044631 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238411c6-bb10-4bde-a910-f2314645abaa None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:18.080823 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5f22c-cc66-48d4-a052-a8ed305c591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:18.081776 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5f22c-cc66-48d4-a052-a8ed305c591a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:18.082242 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5f22c-cc66-48d4-a052-a8ed305c591a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:18.082813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5f22c-cc66-48d4-a052-a8ed305c591a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:18.093926 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5f22c-cc66-48d4-a052-a8ed305c591a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-24d5f22c-cc66-48d4-a052-a8ed305c591a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:18.099085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:18.100092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:18.101001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:18.101001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:18.101001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:18.101001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:18.101001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:18.101001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:18.101001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:18.101001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:18.101001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:18.101001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:18.101001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:18.101001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:18.103498 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 322/642] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:14:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:18.109379 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8992ab3-0350-4d3b-beda-a69f50bef23b None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:18.130005 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:18.222192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8992ab3-0350-4d3b-beda-a69f50bef23b None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:18.259878 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be86bd4-35dd-43d2-86a7-c84da0578d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:18.260920 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be86bd4-35dd-43d2-86a7-c84da0578d63 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:18.261369 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be86bd4-35dd-43d2-86a7-c84da0578d63 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:18.261952 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be86bd4-35dd-43d2-86a7-c84da0578d63 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:18.262875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be86bd4-35dd-43d2-86a7-c84da0578d63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:18.263351 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be86bd4-35dd-43d2-86a7-c84da0578d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:18.264904 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be86bd4-35dd-43d2-86a7-c84da0578d63 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:18.278523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 321/643] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:18.280507 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5f22c-cc66-48d4-a052-a8ed305c591a None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:18.343866 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:18.391637 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5f22c-cc66-48d4-a052-a8ed305c591a None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:18.427831 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd075233-4cae-4d1e-9c20-179b98c4d73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:18.428829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd075233-4cae-4d1e-9c20-179b98c4d73a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:18.429273 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd075233-4cae-4d1e-9c20-179b98c4d73a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:18.429707 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd075233-4cae-4d1e-9c20-179b98c4d73a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:18.440600 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd075233-4cae-4d1e-9c20-179b98c4d73a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:18.442951 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd075233-4cae-4d1e-9c20-179b98c4d73a None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:18.459672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-cd075233-4cae-4d1e-9c20-179b98c4d73a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:18.459672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:18.459672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:18.459672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:18.459672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:18.459672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:18.459672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:18.459672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:18.459672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:18.459672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:18.459672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:18.459672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:18.459672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:18.459672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:18.459672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:18.460619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:18.461513 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:18.461513 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:18.461513 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:18.461513 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:18.467903 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 323/644] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:18.469451 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be86bd4-35dd-43d2-86a7-c84da0578d63 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:18.556344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:18.576225 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be86bd4-35dd-43d2-86a7-c84da0578d63 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:18.615153 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbc94b-e8d3-41a4-8710-21f6925210d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:18.615728 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbc94b-e8d3-41a4-8710-21f6925210d5 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:18.616011 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbc94b-e8d3-41a4-8710-21f6925210d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:18.616283 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbc94b-e8d3-41a4-8710-21f6925210d5 None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:18.617022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbc94b-e8d3-41a4-8710-21f6925210d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:18.617329 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbc94b-e8d3-41a4-8710-21f6925210d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:18.618728 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbc94b-e8d3-41a4-8710-21f6925210d5 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:18.632218 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 322/645] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:18.638056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd075233-4cae-4d1e-9c20-179b98c4d73a None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:18.741568 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd075233-4cae-4d1e-9c20-179b98c4d73a None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:18.749861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:18.778740 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c7e52-dbc1-40b4-a14e-6ed0c8cafc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:18.779751 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c7e52-dbc1-40b4-a14e-6ed0c8cafc15 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:18.780245 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c7e52-dbc1-40b4-a14e-6ed0c8cafc15 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:18.780726 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c7e52-dbc1-40b4-a14e-6ed0c8cafc15 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:18.789573 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c7e52-dbc1-40b4-a14e-6ed0c8cafc15 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:18.791578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c7e52-dbc1-40b4-a14e-6ed0c8cafc15 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-b94c7e52-dbc1-40b4-a14e-6ed0c8cafc15 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:18.805361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:18.806499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:18.807447 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:18.807447 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:18.807447 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:18.807447 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:18.807447 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:18.807447 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:18.807447 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:18.807447 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:18.807447 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:14:18.807447 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:18.809381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 324/646] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Jul 26 10:14:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:18.815466 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbc94b-e8d3-41a4-8710-21f6925210d5 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:18.927060 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbc94b-e8d3-41a4-8710-21f6925210d5 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:18.962259 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa7c48-d2e7-461b-b051-5899aedaf6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:18.962929 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa7c48-d2e7-461b-b051-5899aedaf6d8 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:18.963210 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa7c48-d2e7-461b-b051-5899aedaf6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:18.963483 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa7c48-d2e7-461b-b051-5899aedaf6d8 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:18.964297 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa7c48-d2e7-461b-b051-5899aedaf6d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:18.964639 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa7c48-d2e7-461b-b051-5899aedaf6d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:18.966075 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa7c48-d2e7-461b-b051-5899aedaf6d8 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:18.984383 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 323/647] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Jul 26 10:14:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:18.984986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:18.990278 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c7e52-dbc1-40b4-a14e-6ed0c8cafc15 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:18.999251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689509a5-180d-45fb-a530-513105c24614 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:18.999541 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689509a5-180d-45fb-a530-513105c24614 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:18.999820 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689509a5-180d-45fb-a530-513105c24614 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:19.001432 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 324/648] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:14:19.006601 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fd4ec-0f0c-407f-b0b4-1c73873887ec None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:19.006889 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fd4ec-0f0c-407f-b0b4-1c73873887ec None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:19.007168 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fd4ec-0f0c-407f-b0b4-1c73873887ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:19.035860 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-eb6fd4ec-0f0c-407f-b0b4-1c73873887ec None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:19.038620 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-eb6fd4ec-0f0c-407f-b0b4-1c73873887ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:19.110774 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c7e52-dbc1-40b4-a14e-6ed0c8cafc15 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:19.127190 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 325/649] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:14:19.151694 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fd4ec-0f0c-407f-b0b4-1c73873887ec None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:19.157757 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408159c-882f-4c98-835f-0f381a6a5a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:19.158392 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408159c-882f-4c98-835f-0f381a6a5a67 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:19.158705 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408159c-882f-4c98-835f-0f381a6a5a67 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:19.158983 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408159c-882f-4c98-835f-0f381a6a5a67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:19.194368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:19.231094 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408159c-882f-4c98-835f-0f381a6a5a67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:19.232566 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408159c-882f-4c98-835f-0f381a6a5a67 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:19.283497 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fd4ec-0f0c-407f-b0b4-1c73873887ec None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:19.321364 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:19.333639 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757e750-377e-4089-a1f2-d331dc33afa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:19.335480 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757e750-377e-4089-a1f2-d331dc33afa5 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:19.335991 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757e750-377e-4089-a1f2-d331dc33afa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:19.336463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757e750-377e-4089-a1f2-d331dc33afa5 None admin] PATH_INFO: `/v3/services/image` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:19.337390 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757e750-377e-4089-a1f2-d331dc33afa5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:19.339013 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757e750-377e-4089-a1f2-d331dc33afa5 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:19.342730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 325/650] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:14:19.343758 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408159c-882f-4c98-835f-0f381a6a5a67 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-b757e750-377e-4089-a1f2-d331dc33afa5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:19.357750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:19.359469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:19.363393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:19.363393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:19.363393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:19.363393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:19.363393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:19.363393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:19.363393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:19.363393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:19.363393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:19.363393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:19.363393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:19.363393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:19.363393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:14:19.363393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:19.363393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 326/651] 10.222.0.60 () {56 vars in 1105 bytes} [Tue Jul 26 10:14:19 2022] GET /identity/v3/services/image => generated 86 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:19.366631 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757e750-377e-4089-a1f2-d331dc33afa5 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:19.428623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:19.471756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408159c-882f-4c98-835f-0f381a6a5a67 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:19.476487 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757e750-377e-4089-a1f2-d331dc33afa5 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:19.511301 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c6a88-4cd3-4115-b9e8-64f23c85e97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:19.512102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c6a88-4cd3-4115-b9e8-64f23c85e97b None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:19.512381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c6a88-4cd3-4115-b9e8-64f23c85e97b None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:19.512653 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c6a88-4cd3-4115-b9e8-64f23c85e97b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:19.522236 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf71d0c-210f-42ce-abf8-edb3a7e0a80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:19.523650 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf71d0c-210f-42ce-abf8-edb3a7e0a80b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:19.524384 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf71d0c-210f-42ce-abf8-edb3a7e0a80b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:19.524889 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf71d0c-210f-42ce-abf8-edb3a7e0a80b None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:19.524995 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c6a88-4cd3-4115-b9e8-64f23c85e97b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:19.525897 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf71d0c-210f-42ce-abf8-edb3a7e0a80b None admin] RBAC: Adding query filter params (name=image) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:19.526406 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf71d0c-210f-42ce-abf8-edb3a7e0a80b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:19.526528 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c6a88-4cd3-4115-b9e8-64f23c85e97b None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:19.528663 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf71d0c-210f-42ce-abf8-edb3a7e0a80b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:19.540049 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 327/652] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:19.540744 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf71d0c-210f-42ce-abf8-edb3a7e0a80b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:19.551836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-309c6a88-4cd3-4115-b9e8-64f23c85e97b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:19.551836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:19.551836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:19.551836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:19.551836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:19.551836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:19.551836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:19.551836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:19.551836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:19.551836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:19.551836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:19.551836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:19.551836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:19.551836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:19.551836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:19.552842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:19.553726 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:19.553726 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:19.553726 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:19.553726 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:19.557932 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 326/653] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:19.558953 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c6a88-4cd3-4115-b9e8-64f23c85e97b None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:19.625748 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:19.686143 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c6a88-4cd3-4115-b9e8-64f23c85e97b None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:19.690397 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf71d0c-210f-42ce-abf8-edb3a7e0a80b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:19.709732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:19.732269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17a767-df56-47c4-b00d-b069d2ba175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:19.733126 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a767-df56-47c4-b00d-b069d2ba175f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:19.733531 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a767-df56-47c4-b00d-b069d2ba175f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:19.733963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a767-df56-47c4-b00d-b069d2ba175f None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:19.735052 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17a767-df56-47c4-b00d-b069d2ba175f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:19.735471 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17a767-df56-47c4-b00d-b069d2ba175f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:19.736867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17a767-df56-47c4-b00d-b069d2ba175f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:19.738827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b20a2-8a74-461f-b8fa-8360d9ffacf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:19.740294 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b20a2-8a74-461f-b8fa-8360d9ffacf7 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:19.740800 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b20a2-8a74-461f-b8fa-8360d9ffacf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:19.741281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b20a2-8a74-461f-b8fa-8360d9ffacf7 None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:19.742310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b20a2-8a74-461f-b8fa-8360d9ffacf7 None admin] RBAC: Adding query filter params (type=image) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:19.742910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b20a2-8a74-461f-b8fa-8360d9ffacf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:19.745174 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b20a2-8a74-461f-b8fa-8360d9ffacf7 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:19.758457 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 327/654] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:19.758692 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 328/655] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:19.761228 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17a767-df56-47c4-b00d-b069d2ba175f None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:19.892518 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17a767-df56-47c4-b00d-b069d2ba175f None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:19.934800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21d0a6-7027-4ac5-828b-160085a0e7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:19.935896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21d0a6-7027-4ac5-828b-160085a0e7b1 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:19.936399 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21d0a6-7027-4ac5-828b-160085a0e7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:19.936870 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21d0a6-7027-4ac5-828b-160085a0e7b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:19.945419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21d0a6-7027-4ac5-828b-160085a0e7b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:19.947353 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21d0a6-7027-4ac5-828b-160085a0e7b1 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:19.960624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-1a21d0a6-7027-4ac5-828b-160085a0e7b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:19.960624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:19.960624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:19.960624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:19.960624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:19.960624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:19.960624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:19.960624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:19.960624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:19.960624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:19.960624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:19.960624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:19.960624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:19.960624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:19.960624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:19.961667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:19.962584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:19.962584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:19.962584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:19.962584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:19.962584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:19.962584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:19.962584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:19.962584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:19.964806 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 328/656] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:19.970657 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b20a2-8a74-461f-b8fa-8360d9ffacf7 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:19.980995 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f1d8a-d430-4be7-929d-f171159290a1 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:19.981342 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f1d8a-d430-4be7-929d-f171159290a1 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:19.981543 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f1d8a-d430-4be7-929d-f171159290a1 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:19.983012 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 329/657] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:19.988340 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07ddd6-6efd-43ed-909c-c9a1e100ee2b None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:19.988889 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07ddd6-6efd-43ed-909c-c9a1e100ee2b None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:19.988889 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07ddd6-6efd-43ed-909c-c9a1e100ee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:20.011830 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-af07ddd6-6efd-43ed-909c-c9a1e100ee2b None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:20.013593 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-af07ddd6-6efd-43ed-909c-c9a1e100ee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:20.053661 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:20.095510 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b20a2-8a74-461f-b8fa-8360d9ffacf7 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:20.106276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 330/658] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:14:20.106276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c34f-adaf-4de1-9ec0-583210044ead None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:20.106276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c34f-adaf-4de1-9ec0-583210044ead None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:20.106276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c34f-adaf-4de1-9ec0-583210044ead None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:20.106891 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 331/659] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:20.108253 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574fa0e-12fd-41f7-86f9-a266b905bbb9 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:20.108534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574fa0e-12fd-41f7-86f9-a266b905bbb9 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:20.108800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574fa0e-12fd-41f7-86f9-a266b905bbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:20.121441 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:20.131426 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-f574fa0e-12fd-41f7-86f9-a266b905bbb9 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:20.132717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-f574fa0e-12fd-41f7-86f9-a266b905bbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:20.140153 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd9426-aa00-4569-b76c-ba9d08679542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:20.140786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9426-aa00-4569-b76c-ba9d08679542 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:20.141068 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9426-aa00-4569-b76c-ba9d08679542 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:20.141347 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9426-aa00-4569-b76c-ba9d08679542 None admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:20.142107 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd9426-aa00-4569-b76c-ba9d08679542 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:20.142418 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd9426-aa00-4569-b76c-ba9d08679542 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:20.143972 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd9426-aa00-4569-b76c-ba9d08679542 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:20.162021 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 329/660] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:14:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:20.162021 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd9426-aa00-4569-b76c-ba9d08679542 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:20.214642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 332/661] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:14:20.214642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574fa0e-12fd-41f7-86f9-a266b905bbb9 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:20.270885 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd9426-aa00-4569-b76c-ba9d08679542 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:20.305287 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736260c-9d25-4391-be03-5b1ddf425519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:20.305962 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736260c-9d25-4391-be03-5b1ddf425519 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:20.306209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736260c-9d25-4391-be03-5b1ddf425519 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:20.306494 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736260c-9d25-4391-be03-5b1ddf425519 None admin] PATH_INFO: `/v3/services/network` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:20.307129 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736260c-9d25-4391-be03-5b1ddf425519 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:20.308544 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736260c-9d25-4391-be03-5b1ddf425519 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-2736260c-9d25-4391-be03-5b1ddf425519 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:20.319975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:20.321000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:20.321831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:20.321831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:20.321831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:20.321831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:20.321831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:20.321831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:20.321831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:20.321831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:20.321831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:20.321831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:20.321831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:20.321831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:20.321831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:14:20.321831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:20.321831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 330/662] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:20 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:20.322670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736260c-9d25-4391-be03-5b1ddf425519 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:20.323173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:20.330171 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574fa0e-12fd-41f7-86f9-a266b905bbb9 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:20.368582 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd961e0-5a8e-47ff-a2e6-5a481ffcf5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:20.369210 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd961e0-5a8e-47ff-a2e6-5a481ffcf5fe None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:20.369485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd961e0-5a8e-47ff-a2e6-5a481ffcf5fe None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:20.369763 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd961e0-5a8e-47ff-a2e6-5a481ffcf5fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:20.370594 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd961e0-5a8e-47ff-a2e6-5a481ffcf5fe None admin] RBAC: Adding query filter params (role.id=7d88b748366a42929784db05d53fe473, scope.project.id=6897068dc29445f7878c7c12a0915d48, user.id=d68b323bc2b54984ad2ed0d248675624) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:20.370936 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd961e0-5a8e-47ff-a2e6-5a481ffcf5fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:20.372480 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd961e0-5a8e-47ff-a2e6-5a481ffcf5fe None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:20.376671 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:20.390460 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 333/663] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:14:20 2022] GET /identity/v3/role_assignments?user.id=d68b323bc2b54984ad2ed0d248675624&scope.project.id=6897068dc29445f7878c7c12a0915d48&role.id=7d88b748366a42929784db05d53fe473 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:20.390460 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd961e0-5a8e-47ff-a2e6-5a481ffcf5fe None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:20.474919 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736260c-9d25-4391-be03-5b1ddf425519 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:20.514302 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754381e0-1cb4-472f-8d5d-424582a0d04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:20.515047 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754381e0-1cb4-472f-8d5d-424582a0d04f None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:20.515446 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754381e0-1cb4-472f-8d5d-424582a0d04f None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:20.515791 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754381e0-1cb4-472f-8d5d-424582a0d04f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:20.516511 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754381e0-1cb4-472f-8d5d-424582a0d04f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:20.518024 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754381e0-1cb4-472f-8d5d-424582a0d04f None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-754381e0-1cb4-472f-8d5d-424582a0d04f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:20.528454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:20.529443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:20.530266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:20.530266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:20.530266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:20.530266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:20.530266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:20.530266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:20.530266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:20.530266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:20.530266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:20.530266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:20.530266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:20.530266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:20.530266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:20.530266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:14:20.530266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:20.531102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd961e0-5a8e-47ff-a2e6-5a481ffcf5fe None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:20.531511 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 331/664] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Jul 26 10:14:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:20.537541 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754381e0-1cb4-472f-8d5d-424582a0d04f None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:20.577447 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fe4fa-336e-444f-89eb-8b9411492ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:20.578231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fe4fa-336e-444f-89eb-8b9411492ba1 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:20.578643 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fe4fa-336e-444f-89eb-8b9411492ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:20.579034 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fe4fa-336e-444f-89eb-8b9411492ba1 None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:20.579823 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fe4fa-336e-444f-89eb-8b9411492ba1 None admin] RBAC: Adding query filter params (name=network) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:20.580133 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fe4fa-336e-444f-89eb-8b9411492ba1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:20.586038 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fe4fa-336e-444f-89eb-8b9411492ba1 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:20.592745 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 334/665] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Jul 26 10:14:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:20.593867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fe4fa-336e-444f-89eb-8b9411492ba1 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:20.627011 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:20.681415 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754381e0-1cb4-472f-8d5d-424582a0d04f None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:20.694005 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:20.716393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fe4fa-336e-444f-89eb-8b9411492ba1 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:20.729170 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f0727-4b18-4f58-96eb-f16b646a7a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:20.729825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f0727-4b18-4f58-96eb-f16b646a7a16 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:20.730393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f0727-4b18-4f58-96eb-f16b646a7a16 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:20.730706 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f0727-4b18-4f58-96eb-f16b646a7a16 None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:20.731450 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f0727-4b18-4f58-96eb-f16b646a7a16 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:20.731762 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f0727-4b18-4f58-96eb-f16b646a7a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:20.733439 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f0727-4b18-4f58-96eb-f16b646a7a16 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:20.739924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 332/666] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Jul 26 10:14:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:20.745361 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f0727-4b18-4f58-96eb-f16b646a7a16 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:20.761123 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389e9a0-8879-48d8-9268-2bb80f73ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:20.762177 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389e9a0-8879-48d8-9268-2bb80f73ab69 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:20.762823 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389e9a0-8879-48d8-9268-2bb80f73ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:20.763431 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389e9a0-8879-48d8-9268-2bb80f73ab69 None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:20.764436 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389e9a0-8879-48d8-9268-2bb80f73ab69 None admin] RBAC: Adding query filter params (type=network) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:20.764931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389e9a0-8879-48d8-9268-2bb80f73ab69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:20.766770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389e9a0-8879-48d8-9268-2bb80f73ab69 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:20.773608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 335/667] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Jul 26 10:14:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:20.869477 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f0727-4b18-4f58-96eb-f16b646a7a16 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:20.908843 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1f260-6f5d-4368-9605-fdf7f6ee840d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:20.909498 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1f260-6f5d-4368-9605-fdf7f6ee840d None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:20.909771 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1f260-6f5d-4368-9605-fdf7f6ee840d None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:20.910033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1f260-6f5d-4368-9605-fdf7f6ee840d None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:20.911019 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1f260-6f5d-4368-9605-fdf7f6ee840d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:20.911325 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1f260-6f5d-4368-9605-fdf7f6ee840d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:20.913094 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1f260-6f5d-4368-9605-fdf7f6ee840d None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:20.918616 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 333/668] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Jul 26 10:14:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:22.065358 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e845d-c518-47d5-bf50-cb1f29313096 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:22.066084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e845d-c518-47d5-bf50-cb1f29313096 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:22.066084 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e845d-c518-47d5-bf50-cb1f29313096 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:22.067611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 336/669] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:22.073683 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9daa88-67f6-49ae-bd20-850402f0a7f2 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:22.074537 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9daa88-67f6-49ae-bd20-850402f0a7f2 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:22.074537 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9daa88-67f6-49ae-bd20-850402f0a7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:22.098805 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-af9daa88-67f6-49ae-bd20-850402f0a7f2 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:22.100026 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-af9daa88-67f6-49ae-bd20-850402f0a7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:22.131146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:22.173114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 334/670] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:14:22.195962 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e845d-c518-47d5-bf50-cb1f29313096 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:22.287849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:22.299333 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e845d-c518-47d5-bf50-cb1f29313096 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:22.333947 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cae3b-da4f-4d3c-bed2-7c308af843a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:22.334632 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cae3b-da4f-4d3c-bed2-7c308af843a6 None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:22.334913 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cae3b-da4f-4d3c-bed2-7c308af843a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:22.335179 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cae3b-da4f-4d3c-bed2-7c308af843a6 None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:22.335885 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cae3b-da4f-4d3c-bed2-7c308af843a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:22.337255 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cae3b-da4f-4d3c-bed2-7c308af843a6 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:22.356140 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 337/671] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Jul 26 10:14:22 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:14:22.798140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf736a5-5553-4265-aec2-dbe1ee7cc26a None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:22.798577 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf736a5-5553-4265-aec2-dbe1ee7cc26a None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:22.798697 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf736a5-5553-4265-aec2-dbe1ee7cc26a None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:22.800385 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 335/672] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:22.806944 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e5bd8-f79d-40ab-af63-a99ec49644bb None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:22.807419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e5bd8-f79d-40ab-af63-a99ec49644bb None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:22.807705 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e5bd8-f79d-40ab-af63-a99ec49644bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:22.830220 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-b93e5bd8-f79d-40ab-af63-a99ec49644bb None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:22.831546 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-b93e5bd8-f79d-40ab-af63-a99ec49644bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:22.932304 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 338/673] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:22 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:14:22.956058 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf736a5-5553-4265-aec2-dbe1ee7cc26a None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:23.072508 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf736a5-5553-4265-aec2-dbe1ee7cc26a None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:23.112732 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151def6-e743-4f72-86a7-0d087b8eccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:23.113384 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151def6-e743-4f72-86a7-0d087b8eccfc None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:23.113656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151def6-e743-4f72-86a7-0d087b8eccfc None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:23.113932 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151def6-e743-4f72-86a7-0d087b8eccfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:23.126271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151def6-e743-4f72-86a7-0d087b8eccfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-d151def6-e743-4f72-86a7-0d087b8eccfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:23.131461 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:23.132395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:23.133240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:23.133240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:23.133240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:23.133240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:23.133240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:23.133240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:23.133240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:23.133240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:23.133240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:23.133240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:23.133240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:23.133240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:23.133240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 336/674] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:14:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:23.138858 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e5bd8-f79d-40ab-af63-a99ec49644bb None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:23.250114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636231fd-3ee6-4ce6-9274-30f5c0d508d9 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:23.250542 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636231fd-3ee6-4ce6-9274-30f5c0d508d9 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:23.250918 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636231fd-3ee6-4ce6-9274-30f5c0d508d9 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:23.252738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 337/675] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:14:23.254934 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:23.261034 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166902e-4a96-4eb8-b483-c3c0f343619e None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:23.261350 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166902e-4a96-4eb8-b483-c3c0f343619e None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:23.262751 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166902e-4a96-4eb8-b483-c3c0f343619e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:23.284326 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-1166902e-4a96-4eb8-b483-c3c0f343619e None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:23.285561 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-1166902e-4a96-4eb8-b483-c3c0f343619e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:23.294218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e5bd8-f79d-40ab-af63-a99ec49644bb None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:23.310144 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:23.330947 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d15e1-d1b4-4254-94f6-a1f8e45d95a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:23.331491 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d15e1-d1b4-4254-94f6-a1f8e45d95a0 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:23.331767 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d15e1-d1b4-4254-94f6-a1f8e45d95a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:23.332035 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d15e1-d1b4-4254-94f6-a1f8e45d95a0 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:23.332754 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d15e1-d1b4-4254-94f6-a1f8e45d95a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:23.333056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d15e1-d1b4-4254-94f6-a1f8e45d95a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:23.334471 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d15e1-d1b4-4254-94f6-a1f8e45d95a0 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:23.346664 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 339/676] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:23.346664 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a413523-986c-4ecc-a9f8-9734f4d7b96f None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:23.346664 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a413523-986c-4ecc-a9f8-9734f4d7b96f None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:23.346664 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a413523-986c-4ecc-a9f8-9734f4d7b96f None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:23.347071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 340/677] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:23.350121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a413523-986c-4ecc-a9f8-9734f4d7b96f None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:23.368710 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 338/678] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:23 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:14:23.370254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88eb37-2f0e-4893-ac3b-5662510b6a03 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:23.370620 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88eb37-2f0e-4893-ac3b-5662510b6a03 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:23.370894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88eb37-2f0e-4893-ac3b-5662510b6a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:23.405899 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-1a88eb37-2f0e-4893-ac3b-5662510b6a03 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:23.408441 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-1a88eb37-2f0e-4893-ac3b-5662510b6a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:23.474603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a413523-986c-4ecc-a9f8-9734f4d7b96f None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:23.485410 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 339/679] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:23 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:14:23.486264 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88eb37-2f0e-4893-ac3b-5662510b6a03 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:23.528809 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a6807-b760-449c-828c-e7e1f099abd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:23.529424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a6807-b760-449c-828c-e7e1f099abd9 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:23.529767 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a6807-b760-449c-828c-e7e1f099abd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:23.530098 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a6807-b760-449c-828c-e7e1f099abd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:23.538521 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:23.543065 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a6807-b760-449c-828c-e7e1f099abd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:23.545292 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a6807-b760-449c-828c-e7e1f099abd9 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:23.562906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-8d7a6807-b760-449c-828c-e7e1f099abd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:23.562906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:23.562906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:23.562906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:23.562906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:23.562906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:23.562906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:23.562906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:23.562906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:23.562906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:23.562906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:23.562906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:23.562906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:23.562906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:23.562906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:23.564071 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:23.569654 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:23.569654 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:23.569654 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:23.569654 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:23.569654 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 341/680] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:23.569654 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a6807-b760-449c-828c-e7e1f099abd9 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:23.588186 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:23.605416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88eb37-2f0e-4893-ac3b-5662510b6a03 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:23.650342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fc18d-968d-4c4c-812f-689d08f29b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:23.651357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fc18d-968d-4c4c-812f-689d08f29b66 None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:23.651859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fc18d-968d-4c4c-812f-689d08f29b66 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:23.652400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fc18d-968d-4c4c-812f-689d08f29b66 None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:23.653625 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fc18d-968d-4c4c-812f-689d08f29b66 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:23.656331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fc18d-968d-4c4c-812f-689d08f29b66 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:23.694464 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 340/681] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Jul 26 10:14:23 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:14:23.694464 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fc18d-968d-4c4c-812f-689d08f29b66 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:23.725127 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a6807-b760-449c-828c-e7e1f099abd9 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:23.772246 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9796cf7-9d3f-4ebd-ba3d-82fc7ea6337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:23.773114 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9796cf7-9d3f-4ebd-ba3d-82fc7ea6337e None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:23.773460 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9796cf7-9d3f-4ebd-ba3d-82fc7ea6337e None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:23.773804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9796cf7-9d3f-4ebd-ba3d-82fc7ea6337e None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:23.774655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9796cf7-9d3f-4ebd-ba3d-82fc7ea6337e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:23.776195 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9796cf7-9d3f-4ebd-ba3d-82fc7ea6337e None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:23.806252 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 342/682] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Jul 26 10:14:23 2022] POST /identity/v3/services => generated 240 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:14:23.844702 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fc18d-968d-4c4c-812f-689d08f29b66 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:23.905272 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5292231-deeb-4924-9b12-aa058f9f907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:23.905922 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5292231-deeb-4924-9b12-aa058f9f907a None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:23.906203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5292231-deeb-4924-9b12-aa058f9f907a None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:23.906508 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5292231-deeb-4924-9b12-aa058f9f907a None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:23.907236 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5292231-deeb-4924-9b12-aa058f9f907a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:23.907544 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5292231-deeb-4924-9b12-aa058f9f907a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:23.909026 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5292231-deeb-4924-9b12-aa058f9f907a None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:23.923767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 341/683] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:23.929500 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9796cf7-9d3f-4ebd-ba3d-82fc7ea6337e None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:23.987281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:24.046490 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9796cf7-9d3f-4ebd-ba3d-82fc7ea6337e None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:24.085649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae3bf6-7d2d-4784-bd86-e087f532273f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:24.086316 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae3bf6-7d2d-4784-bd86-e087f532273f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:24.086631 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae3bf6-7d2d-4784-bd86-e087f532273f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:24.086911 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae3bf6-7d2d-4784-bd86-e087f532273f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:24.096463 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae3bf6-7d2d-4784-bd86-e087f532273f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:24.097865 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae3bf6-7d2d-4784-bd86-e087f532273f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-daae3bf6-7d2d-4784-bd86-e087f532273f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:24.110808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:24.111969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:24.114244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:24.114244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:24.114244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:24.114244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:24.114244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:24.114244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:24.114244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:24.114244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:24.114244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:14:24.114244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:24.114244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 343/684] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Jul 26 10:14:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:24.118117 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5292231-deeb-4924-9b12-aa058f9f907a None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:24.123729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:24.249355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5292231-deeb-4924-9b12-aa058f9f907a None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:24.307508 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510b30c-4c5d-4485-ba5b-b08b4ac882c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:24.308756 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510b30c-4c5d-4485-ba5b-b08b4ac882c1 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:24.309386 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510b30c-4c5d-4485-ba5b-b08b4ac882c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:24.309865 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510b30c-4c5d-4485-ba5b-b08b4ac882c1 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:24.311120 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510b30c-4c5d-4485-ba5b-b08b4ac882c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:24.311815 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510b30c-4c5d-4485-ba5b-b08b4ac882c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:24.313684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510b30c-4c5d-4485-ba5b-b08b4ac882c1 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:24.336356 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 342/685] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Jul 26 10:14:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:24.341858 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae3bf6-7d2d-4784-bd86-e087f532273f None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:24.459981 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae3bf6-7d2d-4784-bd86-e087f532273f None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:24.468148 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:24.498883 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2de55-4403-47db-8525-d26c271f59df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:24.499561 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2de55-4403-47db-8525-d26c271f59df None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:24.499844 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2de55-4403-47db-8525-d26c271f59df None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:24.500130 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2de55-4403-47db-8525-d26c271f59df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:24.515799 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2de55-4403-47db-8525-d26c271f59df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:24.518014 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2de55-4403-47db-8525-d26c271f59df None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:24.536807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-42a2de55-4403-47db-8525-d26c271f59df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:24.536807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:24.536807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:24.536807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:24.536807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:24.536807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:24.536807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:24.536807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:24.536807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:24.536807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:24.536807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:24.536807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:24.536807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:24.536807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:24.536807 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:24.538125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:24.539282 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:24.539282 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:24.539282 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:24.539282 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:24.539282 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 344/686] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:24.544366 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510b30c-4c5d-4485-ba5b-b08b4ac882c1 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:24.619136 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:24.663426 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510b30c-4c5d-4485-ba5b-b08b4ac882c1 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:24.703992 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa873c-27ce-40c6-8b69-622e0c14abad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:24.704729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa873c-27ce-40c6-8b69-622e0c14abad None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:24.705017 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa873c-27ce-40c6-8b69-622e0c14abad None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:24.705303 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa873c-27ce-40c6-8b69-622e0c14abad None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:24.706103 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa873c-27ce-40c6-8b69-622e0c14abad None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:24.706425 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa873c-27ce-40c6-8b69-622e0c14abad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:24.708194 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa873c-27ce-40c6-8b69-622e0c14abad None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:24.722204 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 343/687] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:24.731643 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2de55-4403-47db-8525-d26c271f59df None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:24.846424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2de55-4403-47db-8525-d26c271f59df None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:24.848759 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002482c-3914-46b8-aca3-a4ddc2e5c72a None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:24.849088 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002482c-3914-46b8-aca3-a4ddc2e5c72a None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:24.849359 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002482c-3914-46b8-aca3-a4ddc2e5c72a None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:24.851542 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 344/688] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:24.857286 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1836e-25dd-47ce-b785-4c35f93594d6 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:24.857567 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1836e-25dd-47ce-b785-4c35f93594d6 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:24.857842 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1836e-25dd-47ce-b785-4c35f93594d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:24.876660 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-5ae1836e-25dd-47ce-b785-4c35f93594d6 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:24.877901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-5ae1836e-25dd-47ce-b785-4c35f93594d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:24.886054 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb883c-1966-4558-9e51-21c54f9d77cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:24.887280 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb883c-1966-4558-9e51-21c54f9d77cf None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:24.887591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb883c-1966-4558-9e51-21c54f9d77cf None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:24.887866 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb883c-1966-4558-9e51-21c54f9d77cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:24.897333 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb883c-1966-4558-9e51-21c54f9d77cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:24.898862 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb883c-1966-4558-9e51-21c54f9d77cf None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:24.915153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-d7bb883c-1966-4558-9e51-21c54f9d77cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:24.915153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:24.915153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:24.915153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:24.915153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:24.915153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:24.915153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:24.915153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:24.915153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:24.915153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:24.915153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:24.915153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:24.915153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:24.915153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:24.915153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:24.916151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:24.917766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:24.917766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:24.917766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:24.917766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:24.917766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:24.917766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:24.917766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:24.917766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:24.917766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 345/689] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:24.923496 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb883c-1966-4558-9e51-21c54f9d77cf None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:24.949756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:24.961048 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 345/690] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:24 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:24.984693 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1836e-25dd-47ce-b785-4c35f93594d6 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:25.056842 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:25.062341 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb883c-1966-4558-9e51-21c54f9d77cf None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:25.101474 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f8e82-db7d-4206-afb8-502acf79abf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:25.102370 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f8e82-db7d-4206-afb8-502acf79abf5 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:25.102855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f8e82-db7d-4206-afb8-502acf79abf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:25.103264 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f8e82-db7d-4206-afb8-502acf79abf5 None admin] PATH_INFO: `/v3/projects` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:25.104355 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f8e82-db7d-4206-afb8-502acf79abf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:25.104843 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f8e82-db7d-4206-afb8-502acf79abf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:25.106571 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f8e82-db7d-4206-afb8-502acf79abf5 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:25.111466 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1836e-25dd-47ce-b785-4c35f93594d6 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:25.121502 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 346/691] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:25.127114 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f8e82-db7d-4206-afb8-502acf79abf5 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:25.154137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba737100-1f71-45ff-8c3e-9b4a30eaca72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:25.154962 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba737100-1f71-45ff-8c3e-9b4a30eaca72 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:25.155125 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba737100-1f71-45ff-8c3e-9b4a30eaca72 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:25.155393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba737100-1f71-45ff-8c3e-9b4a30eaca72 None admin] PATH_INFO: `/v3/services/image` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:25.156033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba737100-1f71-45ff-8c3e-9b4a30eaca72 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:25.157421 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba737100-1f71-45ff-8c3e-9b4a30eaca72 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-ba737100-1f71-45ff-8c3e-9b4a30eaca72 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:25.167844 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:25.168939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:25.169785 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:25.169785 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:25.169785 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:25.169785 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:25.169785 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:25.169785 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:25.169785 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:25.169785 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:25.169785 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:25.169785 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:25.169785 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:25.169785 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:25.169785 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:14:25.169785 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:25.172891 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 346/692] 10.222.0.60 () {56 vars in 1105 bytes} [Tue Jul 26 10:14:24 2022] GET /identity/v3/services/image => generated 86 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:25.178731 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba737100-1f71-45ff-8c3e-9b4a30eaca72 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:25.233015 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:25.265468 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f8e82-db7d-4206-afb8-502acf79abf5 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:25.305646 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba737100-1f71-45ff-8c3e-9b4a30eaca72 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:25.312528 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f06085-9853-4569-b141-181279d4f402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:25.314513 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f06085-9853-4569-b141-181279d4f402 None admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:25.315179 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f06085-9853-4569-b141-181279d4f402 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:25.315658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f06085-9853-4569-b141-181279d4f402 None admin] PATH_INFO: `/v3/projects/6897068dc29445f7878c7c12a0915d48/users/d68b323bc2b54984ad2ed0d248675624/roles/7d88b748366a42929784db05d53fe473` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:25.319075 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f06085-9853-4569-b141-181279d4f402 None admin] RBAC: Authorizing `identity:create_grant(project_id=6897068dc29445f7878c7c12a0915d48, user_id=d68b323bc2b54984ad2ed0d248675624, role_id=7d88b748366a42929784db05d53fe473)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:25.321059 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f06085-9853-4569-b141-181279d4f402 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:25.321900 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:25.354601 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 347/693] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:14:25 2022] PUT /identity/v3/projects/6897068dc29445f7878c7c12a0915d48/users/d68b323bc2b54984ad2ed0d248675624/roles/7d88b748366a42929784db05d53fe473 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 10:14:25.364752 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37d0a0-d2a7-44d0-a866-9ba98d425d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:25.365864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37d0a0-d2a7-44d0-a866-9ba98d425d1d None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:25.366357 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37d0a0-d2a7-44d0-a866-9ba98d425d1d None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:25.366897 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37d0a0-d2a7-44d0-a866-9ba98d425d1d None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:25.368249 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37d0a0-d2a7-44d0-a866-9ba98d425d1d None admin] RBAC: Adding query filter params (name=image) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:25.368800 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37d0a0-d2a7-44d0-a866-9ba98d425d1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:25.370616 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37d0a0-d2a7-44d0-a866-9ba98d425d1d None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:25.377242 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 347/694] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:25.386331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f06085-9853-4569-b141-181279d4f402 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:25.498703 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f06085-9853-4569-b141-181279d4f402 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:25.537309 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fe9f2-0f44-4479-bf6a-5583273a0e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:25.538385 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fe9f2-0f44-4479-bf6a-5583273a0e26 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:25.538833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fe9f2-0f44-4479-bf6a-5583273a0e26 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:25.539265 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fe9f2-0f44-4479-bf6a-5583273a0e26 None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:25.540291 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fe9f2-0f44-4479-bf6a-5583273a0e26 None admin] RBAC: Adding query filter params (type=image) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:25.540747 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fe9f2-0f44-4479-bf6a-5583273a0e26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:25.542403 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fe9f2-0f44-4479-bf6a-5583273a0e26 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:25.548800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 348/695] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:25.554986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37d0a0-d2a7-44d0-a866-9ba98d425d1d None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:25.673384 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37d0a0-d2a7-44d0-a866-9ba98d425d1d None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:25.710249 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee6880-f736-4d1a-b504-f00d60a165ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:25.711326 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee6880-f736-4d1a-b504-f00d60a165ab None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:25.711754 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee6880-f736-4d1a-b504-f00d60a165ab None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:25.712170 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee6880-f736-4d1a-b504-f00d60a165ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:25.713096 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee6880-f736-4d1a-b504-f00d60a165ab None admin] RBAC: Adding query filter params (interface=public, service_id=285cbe041bce4ea7b61661a7cb156c13, region_id=RegionOne) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:25.713554 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee6880-f736-4d1a-b504-f00d60a165ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:25.715179 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee6880-f736-4d1a-b504-f00d60a165ab None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:25.724606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 348/696] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Jul 26 10:14:25 2022] GET /identity/v3/endpoints?service_id=285cbe041bce4ea7b61661a7cb156c13&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:25.730889 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fe9f2-0f44-4479-bf6a-5583273a0e26 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:25.734269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:25.855766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fe9f2-0f44-4479-bf6a-5583273a0e26 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:25.890362 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f92b8-1ccb-4b06-a927-dc412443bf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:25.891016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f92b8-1ccb-4b06-a927-dc412443bf0c None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:25.891287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f92b8-1ccb-4b06-a927-dc412443bf0c None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:25.891559 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f92b8-1ccb-4b06-a927-dc412443bf0c None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:25.892205 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f92b8-1ccb-4b06-a927-dc412443bf0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:25.893593 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f92b8-1ccb-4b06-a927-dc412443bf0c None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:25.899759 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 349/697] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Jul 26 10:14:25 2022] GET /identity/v3/services => generated 1002 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:14:26.159263 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cb4bc-dd17-4fae-aac5-608c7f2fee6f None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:26.159803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cb4bc-dd17-4fae-aac5-608c7f2fee6f None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:26.159803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cb4bc-dd17-4fae-aac5-608c7f2fee6f None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:26.161403 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 349/698] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:26.167363 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159d2f-e5e8-4fd1-bfff-3afafe29a358 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:26.167655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159d2f-e5e8-4fd1-bfff-3afafe29a358 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:26.167929 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159d2f-e5e8-4fd1-bfff-3afafe29a358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:26.186355 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-95159d2f-e5e8-4fd1-bfff-3afafe29a358 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:26.187578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-95159d2f-e5e8-4fd1-bfff-3afafe29a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:26.257211 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:26.265870 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 350/699] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:26 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:26.289445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cb4bc-dd17-4fae-aac5-608c7f2fee6f None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:26.345088 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:26.400334 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e74dd-039a-43e7-ab5c-5b2a4844d157 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:26.401337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e74dd-039a-43e7-ab5c-5b2a4844d157 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:26.401861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e74dd-039a-43e7-ab5c-5b2a4844d157 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:26.403748 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 351/700] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:14:26.409123 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f542d-b57d-4b37-91a2-eb5349cce88f None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:26.409416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cb4bc-dd17-4fae-aac5-608c7f2fee6f None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:26.409919 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f542d-b57d-4b37-91a2-eb5349cce88f None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:26.410404 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f542d-b57d-4b37-91a2-eb5349cce88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:26.429296 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-da2f542d-b57d-4b37-91a2-eb5349cce88f None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:26.430857 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-da2f542d-b57d-4b37-91a2-eb5349cce88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:26.448725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15f6f6-136b-4747-9886-120fa3f70bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:26.449533 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15f6f6-136b-4747-9886-120fa3f70bb6 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:26.449811 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15f6f6-136b-4747-9886-120fa3f70bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:26.450079 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15f6f6-136b-4747-9886-120fa3f70bb6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:26.450773 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15f6f6-136b-4747-9886-120fa3f70bb6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:26.452415 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15f6f6-136b-4747-9886-120fa3f70bb6 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-eb15f6f6-136b-4747-9886-120fa3f70bb6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:26.464353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:26.465331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:26.466211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 350/701] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Jul 26 10:14:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:26.471750 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15f6f6-136b-4747-9886-120fa3f70bb6 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:26.514456 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 352/702] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:26 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:14:26.533092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f542d-b57d-4b37-91a2-eb5349cce88f None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:26.607293 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15f6f6-136b-4747-9886-120fa3f70bb6 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:26.625133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:26.648598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f542d-b57d-4b37-91a2-eb5349cce88f None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:26.655366 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acb5ba-5f9b-44c9-a439-d31b9c2b2e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:26.656135 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acb5ba-5f9b-44c9-a439-d31b9c2b2e4b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:26.656619 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acb5ba-5f9b-44c9-a439-d31b9c2b2e4b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:26.656961 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acb5ba-5f9b-44c9-a439-d31b9c2b2e4b None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:26.657666 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acb5ba-5f9b-44c9-a439-d31b9c2b2e4b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:26.657977 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acb5ba-5f9b-44c9-a439-d31b9c2b2e4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:26.659576 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acb5ba-5f9b-44c9-a439-d31b9c2b2e4b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:26.670489 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 351/703] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Jul 26 10:14:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:26.672463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acb5ba-5f9b-44c9-a439-d31b9c2b2e4b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:26.689326 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:26.701596 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94947937-d557-4ef3-8d66-90952e69e762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:26.702289 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94947937-d557-4ef3-8d66-90952e69e762 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:26.702667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94947937-d557-4ef3-8d66-90952e69e762 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:26.702947 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94947937-d557-4ef3-8d66-90952e69e762 None admin] PATH_INFO: `/v3/services/network` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:26.703601 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94947937-d557-4ef3-8d66-90952e69e762 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:26.705034 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94947937-d557-4ef3-8d66-90952e69e762 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-94947937-d557-4ef3-8d66-90952e69e762 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:26.717155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:26.718227 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:26.719517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:26.719517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:26.719517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:26.719517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:26.719517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:26.719517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:26.719517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:26.719517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:26.719517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:26.719517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:26.719517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:26.719517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:26.719517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:14:26.719517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:26.723749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 353/704] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:26 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:26.724719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94947937-d557-4ef3-8d66-90952e69e762 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:26.807220 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acb5ba-5f9b-44c9-a439-d31b9c2b2e4b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:26.842321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94947937-d557-4ef3-8d66-90952e69e762 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:26.852183 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec803d6a-43be-4966-8de7-c981aebc7235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:26.853257 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec803d6a-43be-4966-8de7-c981aebc7235 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:26.853725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec803d6a-43be-4966-8de7-c981aebc7235 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:26.854183 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec803d6a-43be-4966-8de7-c981aebc7235 None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:26.855158 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec803d6a-43be-4966-8de7-c981aebc7235 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:26.855673 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec803d6a-43be-4966-8de7-c981aebc7235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:26.857259 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec803d6a-43be-4966-8de7-c981aebc7235 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:26.868868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 352/705] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Jul 26 10:14:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:26.870184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec803d6a-43be-4966-8de7-c981aebc7235 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:26.880463 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e11a4-b690-423c-a34c-66b405ef9c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:26.881162 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e11a4-b690-423c-a34c-66b405ef9c08 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:26.881443 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e11a4-b690-423c-a34c-66b405ef9c08 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:26.881726 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e11a4-b690-423c-a34c-66b405ef9c08 None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:26.882473 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e11a4-b690-423c-a34c-66b405ef9c08 None admin] RBAC: Adding query filter params (name=network) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:26.882782 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e11a4-b690-423c-a34c-66b405ef9c08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:26.884224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e11a4-b690-423c-a34c-66b405ef9c08 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:26.894419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 354/706] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Jul 26 10:14:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:26.895550 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e11a4-b690-423c-a34c-66b405ef9c08 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:26.910295 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:26.956818 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:26.984026 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec803d6a-43be-4966-8de7-c981aebc7235 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:27.013053 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e11a4-b690-423c-a34c-66b405ef9c08 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:27.032848 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927e711-7940-40ed-9654-8c20188138ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:27.033816 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927e711-7940-40ed-9654-8c20188138ae None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:27.034292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927e711-7940-40ed-9654-8c20188138ae None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:27.034819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927e711-7940-40ed-9654-8c20188138ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:27.035797 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927e711-7940-40ed-9654-8c20188138ae None admin] RBAC: Adding query filter params (interface=public, service_id=7797ce9c715a4cc7a7663a7f80f68a70, region_id=RegionOne) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:27.036304 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927e711-7940-40ed-9654-8c20188138ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:27.038232 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927e711-7940-40ed-9654-8c20188138ae None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:27.044359 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 353/707] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Jul 26 10:14:26 2022] GET /identity/v3/endpoints?service_id=7797ce9c715a4cc7a7663a7f80f68a70&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:27.049449 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927e711-7940-40ed-9654-8c20188138ae None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:27.053949 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31a305-cb26-4670-afa1-eb6d7b2e8060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:27.054767 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31a305-cb26-4670-afa1-eb6d7b2e8060 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:27.055111 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31a305-cb26-4670-afa1-eb6d7b2e8060 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:27.055451 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31a305-cb26-4670-afa1-eb6d7b2e8060 None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:27.056928 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31a305-cb26-4670-afa1-eb6d7b2e8060 None admin] RBAC: Adding query filter params (type=network) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:27.056928 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31a305-cb26-4670-afa1-eb6d7b2e8060 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:27.058088 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31a305-cb26-4670-afa1-eb6d7b2e8060 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:27.063823 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 355/708] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Jul 26 10:14:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:27.069198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31a305-cb26-4670-afa1-eb6d7b2e8060 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:27.156152 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:27.161748 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927e711-7940-40ed-9654-8c20188138ae None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:27.176992 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31a305-cb26-4670-afa1-eb6d7b2e8060 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:27.194914 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:27.204285 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120fbd9-6aec-4534-8756-e002b7fc3b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:27.205558 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120fbd9-6aec-4534-8756-e002b7fc3b34 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:27.206192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120fbd9-6aec-4534-8756-e002b7fc3b34 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:27.206683 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120fbd9-6aec-4534-8756-e002b7fc3b34 None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:27.207446 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120fbd9-6aec-4534-8756-e002b7fc3b34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:27.209055 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120fbd9-6aec-4534-8756-e002b7fc3b34 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:27.214609 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a16b3-b8db-4df4-8621-863ee4540665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:27.215415 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a16b3-b8db-4df4-8621-863ee4540665 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:27.215856 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a16b3-b8db-4df4-8621-863ee4540665 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:27.216300 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a16b3-b8db-4df4-8621-863ee4540665 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:27.217342 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a16b3-b8db-4df4-8621-863ee4540665 None admin] RBAC: Adding query filter params (interface=public, service_id=3c08968b4e8049c885ae5bd38acf17d5, region_id=RegionOne) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:27.217853 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a16b3-b8db-4df4-8621-863ee4540665 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:27.219489 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a16b3-b8db-4df4-8621-863ee4540665 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:27.221861 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 354/709] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Jul 26 10:14:27 2022] GET /identity/v3/services => generated 1002 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:14:27.229191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 356/710] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Jul 26 10:14:27 2022] GET /identity/v3/endpoints?service_id=3c08968b4e8049c885ae5bd38acf17d5&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:27.238509 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120fbd9-6aec-4534-8756-e002b7fc3b34 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:27.350905 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120fbd9-6aec-4534-8756-e002b7fc3b34 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:27.387243 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830abdf-8a67-407c-930f-b9537e88e741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:27.387881 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830abdf-8a67-407c-930f-b9537e88e741 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:27.388161 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830abdf-8a67-407c-930f-b9537e88e741 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:27.388434 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830abdf-8a67-407c-930f-b9537e88e741 None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:27.389110 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830abdf-8a67-407c-930f-b9537e88e741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:27.390537 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830abdf-8a67-407c-930f-b9537e88e741 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:27.397161 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 355/711] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Jul 26 10:14:27 2022] GET /identity/v3/services => generated 1002 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:14:27.877792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1b7aa-a080-428e-8ea0-c12df604af88 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:27.878339 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1b7aa-a080-428e-8ea0-c12df604af88 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:27.878650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1b7aa-a080-428e-8ea0-c12df604af88 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:27.880388 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 357/712] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:27.885827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a14487-046d-49cd-8821-de699a76a12f None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:27.886299 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a14487-046d-49cd-8821-de699a76a12f None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:27.886692 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a14487-046d-49cd-8821-de699a76a12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:27.905503 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-31a14487-046d-49cd-8821-de699a76a12f None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:27.907050 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-31a14487-046d-49cd-8821-de699a76a12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:27.930041 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:27.981180 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 356/713] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:27 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:28.005583 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1b7aa-a080-428e-8ea0-c12df604af88 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:28.158267 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1b7aa-a080-428e-8ea0-c12df604af88 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:28.195041 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c69fd-747e-4632-bd00-450fcc93f7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:28.195715 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c69fd-747e-4632-bd00-450fcc93f7e5 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:28.195988 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c69fd-747e-4632-bd00-450fcc93f7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:28.196257 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c69fd-747e-4632-bd00-450fcc93f7e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:28.208775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c69fd-747e-4632-bd00-450fcc93f7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-4b0c69fd-747e-4632-bd00-450fcc93f7e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:28.213963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:28.215320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:28.216369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:28.216369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:28.216369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:28.216369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:28.216369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:28.216369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:28.216369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:28.216369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:28.216369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:28.216369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:28.216369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:28.216369 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:28.219111 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b0a7e-8202-4ff5-ba69-f3148b0877fd None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:28.219111 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b0a7e-8202-4ff5-ba69-f3148b0877fd None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:28.219111 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b0a7e-8202-4ff5-ba69-f3148b0877fd None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:28.219912 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 357/715] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:28.220041 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 358/715] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:14:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:28.221545 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b0a7e-8202-4ff5-ba69-f3148b0877fd None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:28.225738 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690d362-2a9e-4f36-97d6-d04d1668c8d9 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:28.225992 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690d362-2a9e-4f36-97d6-d04d1668c8d9 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:28.226270 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690d362-2a9e-4f36-97d6-d04d1668c8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:28.247072 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-2690d362-2a9e-4f36-97d6-d04d1668c8d9 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:28.248946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-2690d362-2a9e-4f36-97d6-d04d1668c8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:28.294973 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:28.338528 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 359/716] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:28 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:14:28.358094 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b0a7e-8202-4ff5-ba69-f3148b0877fd None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:28.366028 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690d362-2a9e-4f36-97d6-d04d1668c8d9 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:28.399044 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2aa9bd-729e-4ecf-8b46-b6e773a3ff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:28.400136 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2aa9bd-729e-4ecf-8b46-b6e773a3ff5f None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:28.400635 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2aa9bd-729e-4ecf-8b46-b6e773a3ff5f None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:28.401169 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2aa9bd-729e-4ecf-8b46-b6e773a3ff5f None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:28.402133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2aa9bd-729e-4ecf-8b46-b6e773a3ff5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:28.402679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2aa9bd-729e-4ecf-8b46-b6e773a3ff5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:28.404252 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2aa9bd-729e-4ecf-8b46-b6e773a3ff5f None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:28.414800 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 358/717] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:28.420801 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2aa9bd-729e-4ecf-8b46-b6e773a3ff5f None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:28.445245 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:28.484427 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690d362-2a9e-4f36-97d6-d04d1668c8d9 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:28.538457 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69002d-d4cf-4642-97db-338406cc738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:28.539127 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69002d-d4cf-4642-97db-338406cc738b None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:28.539402 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69002d-d4cf-4642-97db-338406cc738b None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:28.539673 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69002d-d4cf-4642-97db-338406cc738b None admin] PATH_INFO: `/v3/services/image` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:28.540309 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69002d-d4cf-4642-97db-338406cc738b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:28.542122 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69002d-d4cf-4642-97db-338406cc738b None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:28.551145 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2aa9bd-729e-4ecf-8b46-b6e773a3ff5f None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-6f69002d-d4cf-4642-97db-338406cc738b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:28.552361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:28.553331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:28.554169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:28.554169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:28.554169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:28.554169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:28.554169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:28.554169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:28.554169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:28.554169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:28.554169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:28.554169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:28.554169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:28.554169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:28.554169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:14:28.554169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:28.554169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 360/718] 10.222.0.60 () {56 vars in 1105 bytes} [Tue Jul 26 10:14:28 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:28.561796 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69002d-d4cf-4642-97db-338406cc738b None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:28.604231 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd2cfe-1e97-44f9-a077-5c16723f1b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:28.605484 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd2cfe-1e97-44f9-a077-5c16723f1b1b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:28.606061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd2cfe-1e97-44f9-a077-5c16723f1b1b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:28.606406 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd2cfe-1e97-44f9-a077-5c16723f1b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:28.617026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:28.623971 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd2cfe-1e97-44f9-a077-5c16723f1b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:28.626136 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd2cfe-1e97-44f9-a077-5c16723f1b1b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:28.641901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-83cd2cfe-1e97-44f9-a077-5c16723f1b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:28.641901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:28.641901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:28.641901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:28.641901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:28.641901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:28.641901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:28.641901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:28.641901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:28.641901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:28.641901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:28.641901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:28.641901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:28.641901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:28.641901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:28.643074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:28.644768 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:28.644768 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:28.644768 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:28.644768 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:28.649360 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 359/719] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:28.650547 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd2cfe-1e97-44f9-a077-5c16723f1b1b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:28.693521 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69002d-d4cf-4642-97db-338406cc738b None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:28.726670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:28.732832 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15ea7c-c8af-466d-a733-963f7e8489fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:28.734562 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15ea7c-c8af-466d-a733-963f7e8489fe None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:28.734984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15ea7c-c8af-466d-a733-963f7e8489fe None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:28.735426 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15ea7c-c8af-466d-a733-963f7e8489fe None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:28.736308 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15ea7c-c8af-466d-a733-963f7e8489fe None admin] RBAC: Adding query filter params (name=image) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:28.736751 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15ea7c-c8af-466d-a733-963f7e8489fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:28.738394 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15ea7c-c8af-466d-a733-963f7e8489fe None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:28.748935 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 361/720] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:28.750149 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15ea7c-c8af-466d-a733-963f7e8489fe None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:28.759289 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd2cfe-1e97-44f9-a077-5c16723f1b1b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:28.796035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363f18b-0612-476d-8e7e-82956f70b03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:28.796661 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363f18b-0612-476d-8e7e-82956f70b03b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:28.796936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363f18b-0612-476d-8e7e-82956f70b03b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:28.797206 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363f18b-0612-476d-8e7e-82956f70b03b None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:28.798114 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363f18b-0612-476d-8e7e-82956f70b03b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:28.798302 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363f18b-0612-476d-8e7e-82956f70b03b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:28.799720 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363f18b-0612-476d-8e7e-82956f70b03b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:28.818240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 360/721] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:28.819657 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363f18b-0612-476d-8e7e-82956f70b03b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:28.861283 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:28.864446 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15ea7c-c8af-466d-a733-963f7e8489fe None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:28.902961 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2870a55-fbaa-4f93-9efb-24d3978acb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:28.904364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2870a55-fbaa-4f93-9efb-24d3978acb82 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:28.904914 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2870a55-fbaa-4f93-9efb-24d3978acb82 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:28.905329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2870a55-fbaa-4f93-9efb-24d3978acb82 None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:28.906147 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2870a55-fbaa-4f93-9efb-24d3978acb82 None admin] RBAC: Adding query filter params (type=image) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:28.906616 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2870a55-fbaa-4f93-9efb-24d3978acb82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:28.908328 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2870a55-fbaa-4f93-9efb-24d3978acb82 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:28.918556 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 362/722] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:28.920404 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2870a55-fbaa-4f93-9efb-24d3978acb82 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:28.927152 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363f18b-0612-476d-8e7e-82956f70b03b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:28.957573 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:28.965026 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4071efd-3f26-419b-b771-fddcadcb49e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:28.965691 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4071efd-3f26-419b-b771-fddcadcb49e6 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:28.965951 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4071efd-3f26-419b-b771-fddcadcb49e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:28.966216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4071efd-3f26-419b-b771-fddcadcb49e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:28.974525 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4071efd-3f26-419b-b771-fddcadcb49e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:28.976056 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4071efd-3f26-419b-b771-fddcadcb49e6 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-e4071efd-3f26-419b-b771-fddcadcb49e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:28.988684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:28.989855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:28.990940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:28.990940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:28.990940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:28.990940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:28.990940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:28.990940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:28.990940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:28.990940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:28.990940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:14:28.990940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:28.994677 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 361/723] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Jul 26 10:14:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:28.995994 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4071efd-3f26-419b-b771-fddcadcb49e6 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:29.037926 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2870a55-fbaa-4f93-9efb-24d3978acb82 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:29.075300 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87927d-e663-4351-8ab3-810d34e1870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:29.076250 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87927d-e663-4351-8ab3-810d34e1870c None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:29.076679 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87927d-e663-4351-8ab3-810d34e1870c None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:29.077236 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87927d-e663-4351-8ab3-810d34e1870c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:29.078085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87927d-e663-4351-8ab3-810d34e1870c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:29.079922 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87927d-e663-4351-8ab3-810d34e1870c None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:29.102322 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4071efd-3f26-419b-b771-fddcadcb49e6 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:29.114624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 363/724] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Jul 26 10:14:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:14:29.152502 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca278f-4840-454f-b11a-b37cccd4b733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:29.153141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca278f-4840-454f-b11a-b37cccd4b733 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:29.153417 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca278f-4840-454f-b11a-b37cccd4b733 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:29.153688 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca278f-4840-454f-b11a-b37cccd4b733 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:29.154529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca278f-4840-454f-b11a-b37cccd4b733 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:29.154827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca278f-4840-454f-b11a-b37cccd4b733 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:29.156285 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca278f-4840-454f-b11a-b37cccd4b733 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:29.182463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 362/725] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Jul 26 10:14:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:29.184003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87927d-e663-4351-8ab3-810d34e1870c None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:29.210695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:29.306305 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87927d-e663-4351-8ab3-810d34e1870c None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:29.344895 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa9629-4e67-47cf-a9b3-ce6af5ace57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:29.345536 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa9629-4e67-47cf-a9b3-ce6af5ace57e None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:29.345811 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa9629-4e67-47cf-a9b3-ce6af5ace57e None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:29.346079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa9629-4e67-47cf-a9b3-ce6af5ace57e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:29.429450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa9629-4e67-47cf-a9b3-ce6af5ace57e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:29.431005 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa9629-4e67-47cf-a9b3-ce6af5ace57e None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:29.452511 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:29.544065 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 364/726] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:29 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:14:29.549723 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca278f-4840-454f-b11a-b37cccd4b733 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:29.600706 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:29.661133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca278f-4840-454f-b11a-b37cccd4b733 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:29.665364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360026ca-b380-4c23-b5f8-694741accc84 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:29.665707 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360026ca-b380-4c23-b5f8-694741accc84 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:29.665917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360026ca-b380-4c23-b5f8-694741accc84 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:29.668841 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 365/727] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:29.674747 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1baeb-8018-4aae-af14-ab259d90f26f None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:29.675384 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1baeb-8018-4aae-af14-ab259d90f26f None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:29.675857 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1baeb-8018-4aae-af14-ab259d90f26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:29.700568 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-fca1baeb-8018-4aae-af14-ab259d90f26f None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:29.701496 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f984a47-3620-46a2-b5a5-21bc5402c878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:29.702150 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f984a47-3620-46a2-b5a5-21bc5402c878 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:29.702445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f984a47-3620-46a2-b5a5-21bc5402c878 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:29.702726 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f984a47-3620-46a2-b5a5-21bc5402c878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:29.703116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-fca1baeb-8018-4aae-af14-ab259d90f26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:29.713741 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f984a47-3620-46a2-b5a5-21bc5402c878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:29.715233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f984a47-3620-46a2-b5a5-21bc5402c878 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:29.730780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-7f984a47-3620-46a2-b5a5-21bc5402c878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:29.730780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:29.730780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:29.730780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:29.730780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:29.730780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:29.730780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:29.730780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:29.730780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:29.730780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:29.730780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:29.730780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:29.730780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:29.730780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:29.730780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:29.731730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:29.732617 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:29.732617 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:29.732617 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:29.732617 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:29.732617 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 363/728] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:29.737730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f984a47-3620-46a2-b5a5-21bc5402c878 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:29.790514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 366/729] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:29 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:14:29.807361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c61841-e787-491e-9efb-16d46ff42fbf None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:29.807624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c61841-e787-491e-9efb-16d46ff42fbf None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:29.807899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c61841-e787-491e-9efb-16d46ff42fbf None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:29.809548 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 367/730] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:14:29.811541 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c61841-e787-491e-9efb-16d46ff42fbf None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:29.838276 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:29.844962 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f984a47-3620-46a2-b5a5-21bc5402c878 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:29.865717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:29.884426 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823ff1a-6f7f-4eb8-a14c-75a37c54c964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:29.885066 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823ff1a-6f7f-4eb8-a14c-75a37c54c964 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:29.885353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823ff1a-6f7f-4eb8-a14c-75a37c54c964 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:29.885632 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823ff1a-6f7f-4eb8-a14c-75a37c54c964 None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:29.886404 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823ff1a-6f7f-4eb8-a14c-75a37c54c964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:29.886755 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823ff1a-6f7f-4eb8-a14c-75a37c54c964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:29.888142 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823ff1a-6f7f-4eb8-a14c-75a37c54c964 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:29.902457 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 364/731] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:29.903326 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5e928-279e-479f-9c71-7c6d2683fb20 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:29.903620 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5e928-279e-479f-9c71-7c6d2683fb20 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:29.903893 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5e928-279e-479f-9c71-7c6d2683fb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:29.922761 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-daf5e928-279e-479f-9c71-7c6d2683fb20 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:29.924115 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-daf5e928-279e-479f-9c71-7c6d2683fb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:29.935855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c61841-e787-491e-9efb-16d46ff42fbf None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:29.976073 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59939a-3ace-44b2-be3b-95b725b1b2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:29.977155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59939a-3ace-44b2-be3b-95b725b1b2f0 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:29.977432 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59939a-3ace-44b2-be3b-95b725b1b2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:29.977707 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59939a-3ace-44b2-be3b-95b725b1b2f0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:29.978382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59939a-3ace-44b2-be3b-95b725b1b2f0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:29.980608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59939a-3ace-44b2-be3b-95b725b1b2f0 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-eb59939a-3ace-44b2-be3b-95b725b1b2f0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:29.990008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:29.991061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:29.991937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:29.991937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:29.991937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:29.991937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:29.991937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:29.991937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:29.991937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:29.991937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:29.991937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:29.991937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:29.991937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:29.991937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:29.991937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:29.991937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:14:29.991937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:29.996347 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 368/732] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Jul 26 10:14:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:29.997039 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59939a-3ace-44b2-be3b-95b725b1b2f0 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:30.006669 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 365/733] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:29 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:30.006669 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5e928-279e-479f-9c71-7c6d2683fb20 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:30.098169 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:30.115397 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5e928-279e-479f-9c71-7c6d2683fb20 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:30.118968 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59939a-3ace-44b2-be3b-95b725b1b2f0 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:30.134025 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:30.154167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b3d1f-af10-4388-91d0-661b98b70fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:30.154829 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b3d1f-af10-4388-91d0-661b98b70fb3 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:30.155154 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b3d1f-af10-4388-91d0-661b98b70fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:30.155374 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b3d1f-af10-4388-91d0-661b98b70fb3 None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:30.156053 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b3d1f-af10-4388-91d0-661b98b70fb3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:30.156356 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b3d1f-af10-4388-91d0-661b98b70fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:30.157204 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff15d00-7027-4067-8fdb-9ab7442da284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:30.157721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b3d1f-af10-4388-91d0-661b98b70fb3 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:30.157877 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff15d00-7027-4067-8fdb-9ab7442da284 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:30.158120 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff15d00-7027-4067-8fdb-9ab7442da284 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:30.158411 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff15d00-7027-4067-8fdb-9ab7442da284 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:30.163454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 366/734] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Jul 26 10:14:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:30.164376 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b3d1f-af10-4388-91d0-661b98b70fb3 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:30.166770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff15d00-7027-4067-8fdb-9ab7442da284 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:30.168706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff15d00-7027-4067-8fdb-9ab7442da284 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:30.182855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-9ff15d00-7027-4067-8fdb-9ab7442da284 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:30.182855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:30.182855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:30.182855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:30.182855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:30.182855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:30.182855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:30.182855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:30.182855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:30.182855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:30.182855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:30.182855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:30.182855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:30.182855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:30.182855 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:30.183820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:30.184783 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:30.184783 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:30.184783 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:30.184783 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:30.184783 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:30.184783 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:30.184783 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:30.184783 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:30.184783 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 369/735] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:30.184783 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff15d00-7027-4067-8fdb-9ab7442da284 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:30.279497 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b3d1f-af10-4388-91d0-661b98b70fb3 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:30.294865 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff15d00-7027-4067-8fdb-9ab7442da284 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:30.314488 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e4797-668f-4bc7-9be2-32bc6dc9e15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:30.315145 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4797-668f-4bc7-9be2-32bc6dc9e15d None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:30.315425 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4797-668f-4bc7-9be2-32bc6dc9e15d None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:30.315696 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4797-668f-4bc7-9be2-32bc6dc9e15d None admin] PATH_INFO: `/v3/services/network` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:30.316331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e4797-668f-4bc7-9be2-32bc6dc9e15d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:30.317704 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e4797-668f-4bc7-9be2-32bc6dc9e15d None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-305e4797-668f-4bc7-9be2-32bc6dc9e15d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:30.327008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:30.328031 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:30.328875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:30.328875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:30.328875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:30.328875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:30.328875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:30.328875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:30.328875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:30.328875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:30.328875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:30.328875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:30.328875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:30.328875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:30.328875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:14:30.328875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:30.328875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 367/736] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:30 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:30.329670 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e4797-668f-4bc7-9be2-32bc6dc9e15d None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:30.339636 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad3f8e-c095-4318-a394-fc6d29a55b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:30.340510 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad3f8e-c095-4318-a394-fc6d29a55b0a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:30.340985 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad3f8e-c095-4318-a394-fc6d29a55b0a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:30.341428 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad3f8e-c095-4318-a394-fc6d29a55b0a None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:30.342402 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad3f8e-c095-4318-a394-fc6d29a55b0a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:30.342909 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad3f8e-c095-4318-a394-fc6d29a55b0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:30.344586 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad3f8e-c095-4318-a394-fc6d29a55b0a None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:30.349054 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:30.351686 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 370/737] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Jul 26 10:14:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:30.352761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad3f8e-c095-4318-a394-fc6d29a55b0a None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:30.407626 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:30.453980 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e4797-668f-4bc7-9be2-32bc6dc9e15d None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:30.479890 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad3f8e-c095-4318-a394-fc6d29a55b0a None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:30.501989 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170add2-d31d-4298-8a11-f4299bcfaead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:30.502762 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170add2-d31d-4298-8a11-f4299bcfaead None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:30.503039 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170add2-d31d-4298-8a11-f4299bcfaead None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:30.503321 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170add2-d31d-4298-8a11-f4299bcfaead None admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:30.504115 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170add2-d31d-4298-8a11-f4299bcfaead None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:30.504414 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170add2-d31d-4298-8a11-f4299bcfaead None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:30.505842 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170add2-d31d-4298-8a11-f4299bcfaead None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:30.518745 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 368/738] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:14:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:30.519357 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b4f1d-9f20-4686-9e5b-c9291b30e24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:30.519581 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170add2-d31d-4298-8a11-f4299bcfaead None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:30.520302 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b4f1d-9f20-4686-9e5b-c9291b30e24c None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:30.520582 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b4f1d-9f20-4686-9e5b-c9291b30e24c None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:30.520851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b4f1d-9f20-4686-9e5b-c9291b30e24c None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:30.521538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b4f1d-9f20-4686-9e5b-c9291b30e24c None admin] RBAC: Adding query filter params (name=network) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:30.521840 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b4f1d-9f20-4686-9e5b-c9291b30e24c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:30.523264 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b4f1d-9f20-4686-9e5b-c9291b30e24c None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:30.529204 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 371/739] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Jul 26 10:14:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:30.530065 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b4f1d-9f20-4686-9e5b-c9291b30e24c None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:30.635216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:30.655629 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b4f1d-9f20-4686-9e5b-c9291b30e24c None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:30.657198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:30.664348 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170add2-d31d-4298-8a11-f4299bcfaead None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:30.693627 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfa80a-ab8b-4b80-9de4-39d917ed90a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:30.694323 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfa80a-ab8b-4b80-9de4-39d917ed90a0 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:30.694464 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfa80a-ab8b-4b80-9de4-39d917ed90a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:30.694741 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfa80a-ab8b-4b80-9de4-39d917ed90a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:30.695532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfa80a-ab8b-4b80-9de4-39d917ed90a0 None admin] RBAC: Adding query filter params (role.id=7d88b748366a42929784db05d53fe473, scope.project.id=6897068dc29445f7878c7c12a0915d48, user.id=d68b323bc2b54984ad2ed0d248675624) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:30.695840 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfa80a-ab8b-4b80-9de4-39d917ed90a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:30.697304 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfa80a-ab8b-4b80-9de4-39d917ed90a0 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:30.702650 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a836d-e142-4704-8515-8fa4a8472149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:30.703491 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 372/740] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:14:30 2022] GET /identity/v3/role_assignments?user.id=d68b323bc2b54984ad2ed0d248675624&scope.project.id=6897068dc29445f7878c7c12a0915d48&role.id=7d88b748366a42929784db05d53fe473 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:30.703599 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a836d-e142-4704-8515-8fa4a8472149 None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:30.704200 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfa80a-ab8b-4b80-9de4-39d917ed90a0 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:30.714983 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a836d-e142-4704-8515-8fa4a8472149 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:30.716191 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a836d-e142-4704-8515-8fa4a8472149 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:30.717810 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a836d-e142-4704-8515-8fa4a8472149 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:30.719982 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a836d-e142-4704-8515-8fa4a8472149 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:30.754221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 369/741] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Jul 26 10:14:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:14:30.841050 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfa80a-ab8b-4b80-9de4-39d917ed90a0 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:30.890269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c73f3-ad5b-4cbe-91c1-3b08ef72c1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:30.890950 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c73f3-ad5b-4cbe-91c1-3b08ef72c1a3 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:30.891229 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c73f3-ad5b-4cbe-91c1-3b08ef72c1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:30.891499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c73f3-ad5b-4cbe-91c1-3b08ef72c1a3 None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:30.892198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c73f3-ad5b-4cbe-91c1-3b08ef72c1a3 None admin] RBAC: Adding query filter params (type=network) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:30.892500 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c73f3-ad5b-4cbe-91c1-3b08ef72c1a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:30.893915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c73f3-ad5b-4cbe-91c1-3b08ef72c1a3 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:30.900576 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 373/742] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Jul 26 10:14:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:30.907407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a836d-e142-4704-8515-8fa4a8472149 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:31.039971 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a836d-e142-4704-8515-8fa4a8472149 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:31.071556 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:31.078689 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e74197-0761-4358-a9da-5a5b1d99cd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:31.079505 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e74197-0761-4358-a9da-5a5b1d99cd3b None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:31.079799 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e74197-0761-4358-a9da-5a5b1d99cd3b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:31.080278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e74197-0761-4358-a9da-5a5b1d99cd3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:31.081272 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e74197-0761-4358-a9da-5a5b1d99cd3b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:31.082707 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e74197-0761-4358-a9da-5a5b1d99cd3b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:31.107258 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 370/743] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Jul 26 10:14:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:14:31.529941 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5ba2e-4d29-4dfb-8f78-f07c54dd915e None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:31.530727 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5ba2e-4d29-4dfb-8f78-f07c54dd915e None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:31.530727 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5ba2e-4d29-4dfb-8f78-f07c54dd915e None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:31.532166 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 374/744] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:31.537876 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e3bf4-fa9e-46b9-98a4-84d33d97905c None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:31.538165 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e3bf4-fa9e-46b9-98a4-84d33d97905c None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:31.538529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e3bf4-fa9e-46b9-98a4-84d33d97905c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:31.557350 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-3e1e3bf4-fa9e-46b9-98a4-84d33d97905c None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:31.558595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-3e1e3bf4-fa9e-46b9-98a4-84d33d97905c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:31.654871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 371/745] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:31 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:31.679275 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5ba2e-4d29-4dfb-8f78-f07c54dd915e None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:31.712448 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:31.793966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5ba2e-4d29-4dfb-8f78-f07c54dd915e None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:31.827388 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261db02-11da-48f7-a60f-8def0c9030b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:31.828100 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261db02-11da-48f7-a60f-8def0c9030b8 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:31.828376 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261db02-11da-48f7-a60f-8def0c9030b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:31.828643 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261db02-11da-48f7-a60f-8def0c9030b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:31.921621 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261db02-11da-48f7-a60f-8def0c9030b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:31.921621 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261db02-11da-48f7-a60f-8def0c9030b8 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:31.947217 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:32.039308 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 375/746] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:31 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:14:32.040720 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e3bf4-fa9e-46b9-98a4-84d33d97905c None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:32.142374 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e3bf4-fa9e-46b9-98a4-84d33d97905c None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:32.155564 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:32.179307 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00955f4-7630-4ac0-b8cb-afd8af8ee800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:32.179948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00955f4-7630-4ac0-b8cb-afd8af8ee800 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:32.180220 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00955f4-7630-4ac0-b8cb-afd8af8ee800 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:32.180486 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00955f4-7630-4ac0-b8cb-afd8af8ee800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:32.190829 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00955f4-7630-4ac0-b8cb-afd8af8ee800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:32.192267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00955f4-7630-4ac0-b8cb-afd8af8ee800 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:32.206859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-b00955f4-7630-4ac0-b8cb-afd8af8ee800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:32.206859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:32.206859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:32.206859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:32.206859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:32.206859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:32.206859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:32.206859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:32.206859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:32.206859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:32.206859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:32.206859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:32.206859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:32.206859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:32.206859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:32.207823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:32.208737 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:14:32.208737 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:32.208737 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:14:32.208737 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:32.208737 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 372/747] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:32.215136 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261db02-11da-48f7-a60f-8def0c9030b8 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:32.316365 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261db02-11da-48f7-a60f-8def0c9030b8 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:32.342766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:32.352626 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c57074-acef-4ba0-b109-daa9b8050fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:32.353252 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c57074-acef-4ba0-b109-daa9b8050fb1 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:32.353514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c57074-acef-4ba0-b109-daa9b8050fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:32.353787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c57074-acef-4ba0-b109-daa9b8050fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:32.354583 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c57074-acef-4ba0-b109-daa9b8050fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:32.354891 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c57074-acef-4ba0-b109-daa9b8050fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:32.356301 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c57074-acef-4ba0-b109-daa9b8050fb1 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:32.368114 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 376/748] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:33.070638 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501f74f-06f5-4cde-86f7-aef566aeacad None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:33.071194 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501f74f-06f5-4cde-86f7-aef566aeacad None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:33.071194 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501f74f-06f5-4cde-86f7-aef566aeacad None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:33.072517 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 373/749] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:33.078109 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9614709-1564-4f9a-97e4-2028bf928f93 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:33.078617 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9614709-1564-4f9a-97e4-2028bf928f93 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:33.078710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9614709-1564-4f9a-97e4-2028bf928f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:33.098292 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-e9614709-1564-4f9a-97e4-2028bf928f93 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:33.099530 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-e9614709-1564-4f9a-97e4-2028bf928f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:33.116609 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa11ae-bc74-49b6-9db4-04b429ae5f66 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:33.116885 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa11ae-bc74-49b6-9db4-04b429ae5f66 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:33.117158 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa11ae-bc74-49b6-9db4-04b429ae5f66 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:33.118596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 374/750] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:14:33.123572 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d9ef0-7228-413e-b942-77e1f71d1fba None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:33.123855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d9ef0-7228-413e-b942-77e1f71d1fba None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:33.124126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d9ef0-7228-413e-b942-77e1f71d1fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:33.143190 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-057d9ef0-7228-413e-b942-77e1f71d1fba None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:33.144402 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-057d9ef0-7228-413e-b942-77e1f71d1fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:33.168325 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 377/751] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:33 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:33.191256 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9614709-1564-4f9a-97e4-2028bf928f93 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:33.215479 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 375/752] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:33 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:33.238686 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d9ef0-7228-413e-b942-77e1f71d1fba None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:33.299027 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9614709-1564-4f9a-97e4-2028bf928f93 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:33.316001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:33.334649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79ea3f-3dbe-43d9-a12a-cb2add8141ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:33.334846 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:33.335340 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79ea3f-3dbe-43d9-a12a-cb2add8141ff None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:33.335632 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79ea3f-3dbe-43d9-a12a-cb2add8141ff None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:33.335975 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79ea3f-3dbe-43d9-a12a-cb2add8141ff None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:33.336633 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79ea3f-3dbe-43d9-a12a-cb2add8141ff None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:33.338051 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79ea3f-3dbe-43d9-a12a-cb2add8141ff None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:33.342175 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d9ef0-7228-413e-b942-77e1f71d1fba None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-ab79ea3f-3dbe-43d9-a12a-cb2add8141ff None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:33.347660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:33.348787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:33.349611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 378/753] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Jul 26 10:14:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:33.355018 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79ea3f-3dbe-43d9-a12a-cb2add8141ff None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:33.379969 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbadad5-3aac-46c2-8676-d645cf339ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:33.380629 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbadad5-3aac-46c2-8676-d645cf339ea9 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:33.380908 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbadad5-3aac-46c2-8676-d645cf339ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:33.381181 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbadad5-3aac-46c2-8676-d645cf339ea9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:33.381848 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbadad5-3aac-46c2-8676-d645cf339ea9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:33.383266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbadad5-3aac-46c2-8676-d645cf339ea9 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-5dbadad5-3aac-46c2-8676-d645cf339ea9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:33.392355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:33.393447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:33.394563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:33.394563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:33.394563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:33.394563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:33.394563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:33.394563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:33.394563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:33.394563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:33.394563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:33.394563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:33.394563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:33.394563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:33.394563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:14:33.394563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:33.394563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 376/754] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:14:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:33.399511 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbadad5-3aac-46c2-8676-d645cf339ea9 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:33.454116 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79ea3f-3dbe-43d9-a12a-cb2add8141ff None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:33.489343 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e89e92-86e6-43a7-98d7-b3b84ec3006b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:33.489972 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e89e92-86e6-43a7-98d7-b3b84ec3006b None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:33.490237 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e89e92-86e6-43a7-98d7-b3b84ec3006b None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:33.490548 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e89e92-86e6-43a7-98d7-b3b84ec3006b None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:33.491225 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e89e92-86e6-43a7-98d7-b3b84ec3006b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:33.491525 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e89e92-86e6-43a7-98d7-b3b84ec3006b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:33.492899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e89e92-86e6-43a7-98d7-b3b84ec3006b None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:33.497634 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 379/755] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Jul 26 10:14:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:33.500063 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbadad5-3aac-46c2-8676-d645cf339ea9 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:33.503698 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e89e92-86e6-43a7-98d7-b3b84ec3006b None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:33.537585 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278260a2-465d-4a9e-a5c7-4b3604f88796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:33.538226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278260a2-465d-4a9e-a5c7-4b3604f88796 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:33.538490 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278260a2-465d-4a9e-a5c7-4b3604f88796 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:33.538783 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278260a2-465d-4a9e-a5c7-4b3604f88796 None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:33.539476 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278260a2-465d-4a9e-a5c7-4b3604f88796 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:33.539781 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278260a2-465d-4a9e-a5c7-4b3604f88796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:33.541170 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278260a2-465d-4a9e-a5c7-4b3604f88796 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:33.546011 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 377/756] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:14:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:33.551926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278260a2-465d-4a9e-a5c7-4b3604f88796 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:33.555078 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:33.576668 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:33.612729 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e89e92-86e6-43a7-98d7-b3b84ec3006b None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:33.649920 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90381c8-d8ca-4cd7-a27c-5fd5419e5ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:33.650596 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90381c8-d8ca-4cd7-a27c-5fd5419e5ad9 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:33.650873 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90381c8-d8ca-4cd7-a27c-5fd5419e5ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:33.651150 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90381c8-d8ca-4cd7-a27c-5fd5419e5ad9 None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:33.651840 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90381c8-d8ca-4cd7-a27c-5fd5419e5ad9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:33.652130 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90381c8-d8ca-4cd7-a27c-5fd5419e5ad9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:33.653645 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90381c8-d8ca-4cd7-a27c-5fd5419e5ad9 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:33.659374 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278260a2-465d-4a9e-a5c7-4b3604f88796 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:33.661172 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 380/757] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Jul 26 10:14:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:33.700708 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce492692-f977-4ee2-852b-78facbf9ad9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:33.701348 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce492692-f977-4ee2-852b-78facbf9ad9e None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:33.701630 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce492692-f977-4ee2-852b-78facbf9ad9e None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:33.701903 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce492692-f977-4ee2-852b-78facbf9ad9e None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:33.702647 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce492692-f977-4ee2-852b-78facbf9ad9e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:33.702974 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce492692-f977-4ee2-852b-78facbf9ad9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:33.704415 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce492692-f977-4ee2-852b-78facbf9ad9e None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:33.710084 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 378/758] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:14:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:35.880628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b8392-e47e-4528-8123-89bf8680da61 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:35.881197 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b8392-e47e-4528-8123-89bf8680da61 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:35.881197 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b8392-e47e-4528-8123-89bf8680da61 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:35.882504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 381/759] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:35.888119 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1add1-b0d5-4c08-b8b5-0ad739191402 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:35.888575 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1add1-b0d5-4c08-b8b5-0ad739191402 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:35.888676 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1add1-b0d5-4c08-b8b5-0ad739191402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:35.907621 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-aca1add1-b0d5-4c08-b8b5-0ad739191402 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:35.908800 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-aca1add1-b0d5-4c08-b8b5-0ad739191402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:35.934334 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8009baa-a13b-45d6-a728-b12f7ae5f1a1 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:35.934643 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8009baa-a13b-45d6-a728-b12f7ae5f1a1 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:35.934942 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8009baa-a13b-45d6-a728-b12f7ae5f1a1 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:35.936565 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 382/760] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:35.942061 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651386f6-a678-4500-89e8-7611072fb769 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:35.942320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651386f6-a678-4500-89e8-7611072fb769 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:35.942725 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651386f6-a678-4500-89e8-7611072fb769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:35.961228 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-651386f6-a678-4500-89e8-7611072fb769 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:35.962459 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-651386f6-a678-4500-89e8-7611072fb769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:35.988433 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 379/761] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:35 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:36.011989 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1add1-b0d5-4c08-b8b5-0ad739191402 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:36.031128 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:36.041012 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 383/762] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:35 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:14:36.064856 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651386f6-a678-4500-89e8-7611072fb769 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:36.104949 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:36.116898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1add1-b0d5-4c08-b8b5-0ad739191402 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:36.151627 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e99129-07cf-4464-8f9d-0856b683ab9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:36.152251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e99129-07cf-4464-8f9d-0856b683ab9f None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:36.152522 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e99129-07cf-4464-8f9d-0856b683ab9f None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:36.152788 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e99129-07cf-4464-8f9d-0856b683ab9f None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:36.153466 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e99129-07cf-4464-8f9d-0856b683ab9f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:36.154872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e99129-07cf-4464-8f9d-0856b683ab9f None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:36.166362 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651386f6-a678-4500-89e8-7611072fb769 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:36.170976 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 380/763] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Jul 26 10:14:36 2022] POST /identity/v3/services => generated 269 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:14:36.213231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e72da-268f-4a9f-8224-e97160dc418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:36.213916 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e72da-268f-4a9f-8224-e97160dc418f None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:36.214160 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e72da-268f-4a9f-8224-e97160dc418f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:36.214458 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e72da-268f-4a9f-8224-e97160dc418f None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:36.215152 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e72da-268f-4a9f-8224-e97160dc418f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:36.216534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e72da-268f-4a9f-8224-e97160dc418f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:36.233784 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 384/764] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Jul 26 10:14:36 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:14:38.449858 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5242e-7c9f-4e0e-8214-e9079f104d81 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:38.450551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5242e-7c9f-4e0e-8214-e9079f104d81 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:38.450551 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5242e-7c9f-4e0e-8214-e9079f104d81 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:38.451791 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 381/765] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:38.457491 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706c91d-a568-4291-bb58-d9146ef9fbe2 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:38.458015 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706c91d-a568-4291-bb58-d9146ef9fbe2 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:38.458015 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706c91d-a568-4291-bb58-d9146ef9fbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:38.477941 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-d706c91d-a568-4291-bb58-d9146ef9fbe2 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:38.479220 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-d706c91d-a568-4291-bb58-d9146ef9fbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:38.556728 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 385/766] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:38 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:38.571453 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee0bec-efa8-4d5c-baed-33b777d68b20 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:38.571832 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee0bec-efa8-4d5c-baed-33b777d68b20 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:38.572163 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee0bec-efa8-4d5c-baed-33b777d68b20 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:38.573622 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 382/767] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:38.579090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68084a9e-c1b6-4912-a5b7-996ef7912d7a None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:38.579370 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68084a9e-c1b6-4912-a5b7-996ef7912d7a None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:38.579642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68084a9e-c1b6-4912-a5b7-996ef7912d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:38.580581 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee0bec-efa8-4d5c-baed-33b777d68b20 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:38.601734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-68084a9e-c1b6-4912-a5b7-996ef7912d7a None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:38.603018 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-68084a9e-c1b6-4912-a5b7-996ef7912d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:38.618971 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:38.674976 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:38.682779 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 386/768] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:38 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:38.706554 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68084a9e-c1b6-4912-a5b7-996ef7912d7a None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:38.710773 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee0bec-efa8-4d5c-baed-33b777d68b20 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:38.750264 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbaff1b-a7a6-4486-b689-6728edbf2cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:38.750956 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaff1b-a7a6-4486-b689-6728edbf2cc8 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:38.751237 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaff1b-a7a6-4486-b689-6728edbf2cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:38.751510 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaff1b-a7a6-4486-b689-6728edbf2cc8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:38.752151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbaff1b-a7a6-4486-b689-6728edbf2cc8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:38.753539 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbaff1b-a7a6-4486-b689-6728edbf2cc8 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-8cbaff1b-a7a6-4486-b689-6728edbf2cc8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:38.766025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:38.767271 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:38.768986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:38.768986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:38.768986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:38.768986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:38.768986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:38.768986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:38.768986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:38.768986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:38.768986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:38.768986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:38.768986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:38.768986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:38.768986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:38.768986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:14:38.768986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:38.772550 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 383/769] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Jul 26 10:14:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:38.773524 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbaff1b-a7a6-4486-b689-6728edbf2cc8 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:38.825897 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68084a9e-c1b6-4912-a5b7-996ef7912d7a None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:38.865373 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59091a0d-24f2-432e-b203-d85d5a73ca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:38.866047 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59091a0d-24f2-432e-b203-d85d5a73ca0d None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:38.866323 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59091a0d-24f2-432e-b203-d85d5a73ca0d None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:38.866628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59091a0d-24f2-432e-b203-d85d5a73ca0d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:38.867276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59091a0d-24f2-432e-b203-d85d5a73ca0d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:38.868823 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59091a0d-24f2-432e-b203-d85d5a73ca0d None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-59091a0d-24f2-432e-b203-d85d5a73ca0d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:38.878598 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:38.879775 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:38.880655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:38.880655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:38.880655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:38.880655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:38.880655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:38.880655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:38.880655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:38.880655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:38.880655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:38.880655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:38.880655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:38.880655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:38.880655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:14:38.880655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:38.880655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 387/770] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:14:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:38.886120 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59091a0d-24f2-432e-b203-d85d5a73ca0d None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:38.891784 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbaff1b-a7a6-4486-b689-6728edbf2cc8 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:38.907622 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:38.926023 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626e73b-609a-4fa1-9b32-9b7d18e214c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:38.926684 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626e73b-609a-4fa1-9b32-9b7d18e214c1 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:38.926964 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626e73b-609a-4fa1-9b32-9b7d18e214c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:38.927241 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626e73b-609a-4fa1-9b32-9b7d18e214c1 None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:38.927929 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626e73b-609a-4fa1-9b32-9b7d18e214c1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:38.928232 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626e73b-609a-4fa1-9b32-9b7d18e214c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:38.929625 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626e73b-609a-4fa1-9b32-9b7d18e214c1 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:38.934820 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 384/771] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Jul 26 10:14:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:38.940403 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626e73b-609a-4fa1-9b32-9b7d18e214c1 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:38.944232 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:38.996668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59091a0d-24f2-432e-b203-d85d5a73ca0d None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:39.035326 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa02f86-9ac8-4eb2-b49b-65aff05ca1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:39.035970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa02f86-9ac8-4eb2-b49b-65aff05ca1b9 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:39.036612 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa02f86-9ac8-4eb2-b49b-65aff05ca1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:39.036874 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa02f86-9ac8-4eb2-b49b-65aff05ca1b9 None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:39.037559 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa02f86-9ac8-4eb2-b49b-65aff05ca1b9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:39.037876 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa02f86-9ac8-4eb2-b49b-65aff05ca1b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:39.039290 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa02f86-9ac8-4eb2-b49b-65aff05ca1b9 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:39.044286 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 388/772] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:14:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:39.044454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626e73b-609a-4fa1-9b32-9b7d18e214c1 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:39.050323 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa02f86-9ac8-4eb2-b49b-65aff05ca1b9 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:39.081314 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456d2a4-ed8f-42a7-82b7-c92c8d39c8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:39.081946 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456d2a4-ed8f-42a7-82b7-c92c8d39c8c9 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:39.082287 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456d2a4-ed8f-42a7-82b7-c92c8d39c8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:39.082586 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456d2a4-ed8f-42a7-82b7-c92c8d39c8c9 None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:39.083270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456d2a4-ed8f-42a7-82b7-c92c8d39c8c9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:39.083573 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456d2a4-ed8f-42a7-82b7-c92c8d39c8c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:39.084959 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456d2a4-ed8f-42a7-82b7-c92c8d39c8c9 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:39.090283 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 385/773] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Jul 26 10:14:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:39.096699 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456d2a4-ed8f-42a7-82b7-c92c8d39c8c9 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:39.131158 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:39.154562 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa02f86-9ac8-4eb2-b49b-65aff05ca1b9 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:39.169404 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:39.190066 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a8a08-e86e-4fa9-b20e-ab6200bf450c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:39.190726 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a8a08-e86e-4fa9-b20e-ab6200bf450c None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:39.190999 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a8a08-e86e-4fa9-b20e-ab6200bf450c None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:39.191267 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a8a08-e86e-4fa9-b20e-ab6200bf450c None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:39.191938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a8a08-e86e-4fa9-b20e-ab6200bf450c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:39.192224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a8a08-e86e-4fa9-b20e-ab6200bf450c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:39.193694 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a8a08-e86e-4fa9-b20e-ab6200bf450c None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:39.199056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 389/774] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:14:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:39.204796 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a8a08-e86e-4fa9-b20e-ab6200bf450c None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:39.204947 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456d2a4-ed8f-42a7-82b7-c92c8d39c8c9 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:39.238544 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba71bf-e76e-46ba-b228-2597317660e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:39.239169 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba71bf-e76e-46ba-b228-2597317660e5 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:39.239440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba71bf-e76e-46ba-b228-2597317660e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:39.239714 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba71bf-e76e-46ba-b228-2597317660e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:39.240469 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba71bf-e76e-46ba-b228-2597317660e5 None admin] RBAC: Adding query filter params (interface=public, service_id=ffd6a16ab96e446da770295b38e19c9e, region_id=RegionOne) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:39.240772 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba71bf-e76e-46ba-b228-2597317660e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:39.242138 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba71bf-e76e-46ba-b228-2597317660e5 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:39.247371 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 386/775] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Jul 26 10:14:39 2022] GET /identity/v3/endpoints?service_id=ffd6a16ab96e446da770295b38e19c9e&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:39.252873 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba71bf-e76e-46ba-b228-2597317660e5 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:39.308427 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a8a08-e86e-4fa9-b20e-ab6200bf450c None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:39.343551 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a060e-520b-4356-83bc-537eb95c1a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:39.344181 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a060e-520b-4356-83bc-537eb95c1a7e None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:39.344459 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a060e-520b-4356-83bc-537eb95c1a7e None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:39.344732 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a060e-520b-4356-83bc-537eb95c1a7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:39.345476 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a060e-520b-4356-83bc-537eb95c1a7e None admin] RBAC: Adding query filter params (interface=public, service_id=793f9c771dca423790e48751056119f0, region_id=RegionOne) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:39.345790 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a060e-520b-4356-83bc-537eb95c1a7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:39.347206 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a060e-520b-4356-83bc-537eb95c1a7e None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:39.352316 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 390/776] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Jul 26 10:14:39 2022] GET /identity/v3/endpoints?service_id=793f9c771dca423790e48751056119f0&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:39.353863 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba71bf-e76e-46ba-b228-2597317660e5 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:39.357950 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a060e-520b-4356-83bc-537eb95c1a7e None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:39.366826 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:39.384562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:39.390814 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618baf0f-080f-489d-bad9-429b3936a23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:39.391441 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618baf0f-080f-489d-bad9-429b3936a23e None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:39.391721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618baf0f-080f-489d-bad9-429b3936a23e None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:39.391988 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618baf0f-080f-489d-bad9-429b3936a23e None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:39.392653 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618baf0f-080f-489d-bad9-429b3936a23e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:39.394023 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618baf0f-080f-489d-bad9-429b3936a23e None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:39.400724 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 387/777] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Jul 26 10:14:39 2022] GET /identity/v3/services => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:14:39.471316 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a060e-520b-4356-83bc-537eb95c1a7e None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:39.511689 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ffc35-38e1-45b8-a2e7-88cabde1cb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:39.512240 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ffc35-38e1-45b8-a2e7-88cabde1cb4b None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:39.512518 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ffc35-38e1-45b8-a2e7-88cabde1cb4b None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:39.512788 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ffc35-38e1-45b8-a2e7-88cabde1cb4b None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:39.513446 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ffc35-38e1-45b8-a2e7-88cabde1cb4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:39.514898 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ffc35-38e1-45b8-a2e7-88cabde1cb4b None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:39.521663 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 391/778] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Jul 26 10:14:39 2022] GET /identity/v3/services => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 10:14:41.665904 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5da7e9-33b0-40ce-a50c-2a5dedd3e5e6 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:41.666546 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5da7e9-33b0-40ce-a50c-2a5dedd3e5e6 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:41.666546 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5da7e9-33b0-40ce-a50c-2a5dedd3e5e6 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:41.667867 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 388/779] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:41.673358 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b175a-3662-453a-b850-c139504923ff None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:41.673833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b175a-3662-453a-b850-c139504923ff None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:41.673934 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b175a-3662-453a-b850-c139504923ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:41.696488 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-8f2b175a-3662-453a-b850-c139504923ff None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:41.697663 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-8f2b175a-3662-453a-b850-c139504923ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:41.744421 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed0b9a-6248-4086-9c4b-8710bbbebcf6 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:41.744773 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed0b9a-6248-4086-9c4b-8710bbbebcf6 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:41.745053 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed0b9a-6248-4086-9c4b-8710bbbebcf6 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:41.746417 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 389/780] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:14:41.753044 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925bc13-1068-4da9-ae37-f444766b0ae4 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:41.753325 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925bc13-1068-4da9-ae37-f444766b0ae4 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:41.753597 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925bc13-1068-4da9-ae37-f444766b0ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:41.768203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:41.773571 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-7925bc13-1068-4da9-ae37-f444766b0ae4 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:41.774894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-7925bc13-1068-4da9-ae37-f444766b0ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:41.778988 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 392/781] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:41 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:41.798010 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b175a-3662-453a-b850-c139504923ff None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:41.843426 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 390/782] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:41 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:14:41.867259 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925bc13-1068-4da9-ae37-f444766b0ae4 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:41.898291 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b175a-3662-453a-b850-c139504923ff None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:41.933866 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0ba5c-767c-4258-9eeb-bbe0030eaaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:41.934569 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0ba5c-767c-4258-9eeb-bbe0030eaaff None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:41.934750 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0ba5c-767c-4258-9eeb-bbe0030eaaff None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:41.935043 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0ba5c-767c-4258-9eeb-bbe0030eaaff None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:41.935670 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0ba5c-767c-4258-9eeb-bbe0030eaaff None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:41.937077 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0ba5c-767c-4258-9eeb-bbe0030eaaff None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-b3b0ba5c-767c-4258-9eeb-bbe0030eaaff None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:41.946717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:41.948000 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:41.949067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:41.949067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:41.949067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:41.949067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:41.949067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:41.949067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:41.949067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:41.949067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:41.949067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:41.949067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:41.949067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:41.949067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:41.949067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:41.949067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:14:41.949067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:41.950766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 393/783] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Jul 26 10:14:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:41.954250 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0ba5c-767c-4258-9eeb-bbe0030eaaff None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:41.980391 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925bc13-1068-4da9-ae37-f444766b0ae4 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:42.008514 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:42.018916 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c30f3-048c-4dff-b821-635a9c85460c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:42.019470 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c30f3-048c-4dff-b821-635a9c85460c None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:42.019755 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c30f3-048c-4dff-b821-635a9c85460c None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:42.020046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c30f3-048c-4dff-b821-635a9c85460c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:42.020694 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c30f3-048c-4dff-b821-635a9c85460c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:42.022214 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c30f3-048c-4dff-b821-635a9c85460c None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:42.026583 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-ce5c30f3-048c-4dff-b821-635a9c85460c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:42.032334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:42.035130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:42.037046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:42.037046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:42.037046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:42.037046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:42.037046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:42.037046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:42.037046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:42.037046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:42.037046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:42.037046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:42.037046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:42.037046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:42.037046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:14:42.037046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:42.037046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 391/784] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:14:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:42.040827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c30f3-048c-4dff-b821-635a9c85460c None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:42.066556 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0ba5c-767c-4258-9eeb-bbe0030eaaff None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:42.103157 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27144f0-6960-49af-bd80-0a5b513f87b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:42.103893 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27144f0-6960-49af-bd80-0a5b513f87b1 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:42.104387 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27144f0-6960-49af-bd80-0a5b513f87b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:42.104792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27144f0-6960-49af-bd80-0a5b513f87b1 None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:42.105632 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27144f0-6960-49af-bd80-0a5b513f87b1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:42.106176 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27144f0-6960-49af-bd80-0a5b513f87b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:42.107975 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27144f0-6960-49af-bd80-0a5b513f87b1 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:42.115943 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 394/785] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Jul 26 10:14:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:42.122274 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27144f0-6960-49af-bd80-0a5b513f87b1 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:42.152656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c30f3-048c-4dff-b821-635a9c85460c None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:42.192191 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868bbed-0ede-4ea1-b240-2a12120eb67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:42.192695 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868bbed-0ede-4ea1-b240-2a12120eb67a None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:42.193002 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868bbed-0ede-4ea1-b240-2a12120eb67a None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:42.193276 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868bbed-0ede-4ea1-b240-2a12120eb67a None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:42.193963 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868bbed-0ede-4ea1-b240-2a12120eb67a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:42.194272 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868bbed-0ede-4ea1-b240-2a12120eb67a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:42.195705 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868bbed-0ede-4ea1-b240-2a12120eb67a None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:42.201962 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 392/786] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:14:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:42.207796 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868bbed-0ede-4ea1-b240-2a12120eb67a None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:42.229514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27144f0-6960-49af-bd80-0a5b513f87b1 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:42.261142 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:42.272681 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a70342-7cd5-4333-9900-e137e95b77f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:42.273328 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a70342-7cd5-4333-9900-e137e95b77f7 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:42.273594 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a70342-7cd5-4333-9900-e137e95b77f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:42.273878 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a70342-7cd5-4333-9900-e137e95b77f7 None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:42.274608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a70342-7cd5-4333-9900-e137e95b77f7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:42.274914 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a70342-7cd5-4333-9900-e137e95b77f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:42.276433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a70342-7cd5-4333-9900-e137e95b77f7 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:42.282450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 395/787] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Jul 26 10:14:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:42.288770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a70342-7cd5-4333-9900-e137e95b77f7 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:42.293849 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:42.372146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868bbed-0ede-4ea1-b240-2a12120eb67a None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:42.410274 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a70342-7cd5-4333-9900-e137e95b77f7 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:42.420620 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59491b45-397b-4be1-8474-6cf79ee8fed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:42.421070 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59491b45-397b-4be1-8474-6cf79ee8fed2 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:42.421354 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59491b45-397b-4be1-8474-6cf79ee8fed2 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:42.421626 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59491b45-397b-4be1-8474-6cf79ee8fed2 None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:42.422328 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59491b45-397b-4be1-8474-6cf79ee8fed2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:42.422664 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59491b45-397b-4be1-8474-6cf79ee8fed2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:42.424058 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59491b45-397b-4be1-8474-6cf79ee8fed2 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:42.429871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 393/788] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Jul 26 10:14:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:42.436222 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59491b45-397b-4be1-8474-6cf79ee8fed2 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:42.452443 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9f93e-fbc7-47c9-be35-5dcd5952f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:42.452995 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9f93e-fbc7-47c9-be35-5dcd5952f2bc None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:42.453276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9f93e-fbc7-47c9-be35-5dcd5952f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:42.453546 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9f93e-fbc7-47c9-be35-5dcd5952f2bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:42.454280 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9f93e-fbc7-47c9-be35-5dcd5952f2bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:42.455713 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9f93e-fbc7-47c9-be35-5dcd5952f2bc None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:42.479440 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 396/789] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Jul 26 10:14:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:14:42.555939 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59491b45-397b-4be1-8474-6cf79ee8fed2 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:42.576631 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:42.609870 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d69c2-5e9a-49e9-bd93-e61140ba54bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:42.610540 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d69c2-5e9a-49e9-bd93-e61140ba54bc None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:42.610817 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d69c2-5e9a-49e9-bd93-e61140ba54bc None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:42.611088 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d69c2-5e9a-49e9-bd93-e61140ba54bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:42.612025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d69c2-5e9a-49e9-bd93-e61140ba54bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:42.613426 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d69c2-5e9a-49e9-bd93-e61140ba54bc None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:42.637852 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 394/790] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Jul 26 10:14:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:14:44.746658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac92220-34bd-445c-a6ed-8b13cc99a11f None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:44.747234 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac92220-34bd-445c-a6ed-8b13cc99a11f None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:44.747234 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac92220-34bd-445c-a6ed-8b13cc99a11f None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:44.748526 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 397/791] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:44.754347 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232350c5-7961-4cfe-92f2-eff032e611ae None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:44.754950 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232350c5-7961-4cfe-92f2-eff032e611ae None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:44.754950 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232350c5-7961-4cfe-92f2-eff032e611ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:44.774898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-232350c5-7961-4cfe-92f2-eff032e611ae None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:44.776269 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-232350c5-7961-4cfe-92f2-eff032e611ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:44.854052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 395/792] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:44 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:44.877441 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac92220-34bd-445c-a6ed-8b13cc99a11f None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:44.921460 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fe22d-1d5b-4566-a79a-74fb1d4c5d4f None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:44.921863 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fe22d-1d5b-4566-a79a-74fb1d4c5d4f None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:44.922005 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fe22d-1d5b-4566-a79a-74fb1d4c5d4f None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:44.923403 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 396/793] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:44.928849 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bea68e-51ca-4f0d-8d28-57aa01b80275 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:44.929134 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bea68e-51ca-4f0d-8d28-57aa01b80275 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:44.929409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bea68e-51ca-4f0d-8d28-57aa01b80275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:44.934177 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:44.948879 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-56bea68e-51ca-4f0d-8d28-57aa01b80275 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:44.950085 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-56bea68e-51ca-4f0d-8d28-57aa01b80275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:44.993771 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac92220-34bd-445c-a6ed-8b13cc99a11f None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:45.031862 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c678c8-e955-417c-ad18-2207dadfbea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:45.032519 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c678c8-e955-417c-ad18-2207dadfbea8 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:45.032787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c678c8-e955-417c-ad18-2207dadfbea8 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:45.033058 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c678c8-e955-417c-ad18-2207dadfbea8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:45.033706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c678c8-e955-417c-ad18-2207dadfbea8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:45.035110 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c678c8-e955-417c-ad18-2207dadfbea8 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:45.040962 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 397/794] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:44 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-57c678c8-e955-417c-ad18-2207dadfbea8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:45.044706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:45.045931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:45.047396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:45.047396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:45.047396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:45.047396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:45.047396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:45.047396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:45.047396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:45.047396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:45.047396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:45.047396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:45.047396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:45.047396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:45.047396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:14:45.047396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:45.047396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 398/795] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:45.051799 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bea68e-51ca-4f0d-8d28-57aa01b80275 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:45.065255 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c678c8-e955-417c-ad18-2207dadfbea8 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:45.079600 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:45.154622 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bea68e-51ca-4f0d-8d28-57aa01b80275 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:45.169285 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c678c8-e955-417c-ad18-2207dadfbea8 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:45.183028 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:45.190637 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684369b3-021c-4e21-8658-660e4bb863b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:45.191268 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684369b3-021c-4e21-8658-660e4bb863b2 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:45.191546 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684369b3-021c-4e21-8658-660e4bb863b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:45.191818 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684369b3-021c-4e21-8658-660e4bb863b2 None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:45.192533 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684369b3-021c-4e21-8658-660e4bb863b2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:45.192842 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684369b3-021c-4e21-8658-660e4bb863b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:45.194209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684369b3-021c-4e21-8658-660e4bb863b2 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:45.199163 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 398/796] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Jul 26 10:14:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:45.204902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684369b3-021c-4e21-8658-660e4bb863b2 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:45.208880 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dc908-908e-4e25-a05f-a160b1e0f0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:45.209526 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dc908-908e-4e25-a05f-a160b1e0f0de None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:45.209787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dc908-908e-4e25-a05f-a160b1e0f0de None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:45.210056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dc908-908e-4e25-a05f-a160b1e0f0de None admin] PATH_INFO: `/v3/projects` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:45.210771 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dc908-908e-4e25-a05f-a160b1e0f0de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:45.212200 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dc908-908e-4e25-a05f-a160b1e0f0de None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:45.214912 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: WARNING keystone.server.flask.common [None req-4f3dc908-908e-4e25-a05f-a160b1e0f0de None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 10:14:45.233718 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.sql.core [None req-4f3dc908-908e-4e25-a05f-a160b1e0f0de None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 10:14:45.233718 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 10:14:45.233718 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [parameters: {'id': '5a434d03b135445e978e45854b40cf0d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 10:14:45.233718 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87125) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 10:14:45.249849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-4f3dc908-908e-4e25-a05f-a160b1e0f0de None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5a434d03b135445e978e45854b40cf0d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5a434d03b135445e978e45854b40cf0d. Jul 26 10:14:45.249849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:45.249849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 10:14:45.249849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 10:14:45.249849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 10:14:45.249849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 10:14:45.249849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 10:14:45.249849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 10:14:45.249849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 10:14:45.249849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application conn.query(q) Jul 26 10:14:45.249849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 10:14:45.249849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 10:14:45.249849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application result.read() Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 26 10:14:45.250761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application next(self.gen) Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application yield resource Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application next(self.gen) Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise self.value Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application session.commit() Jul 26 10:14:45.251734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self.session.flush() Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application compat.raise_( Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 10:14:45.252649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 10:14:45.253595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 10:14:45.253595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 10:14:45.253595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 10:14:45.253595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 10:14:45.253595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 10:14:45.253595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 10:14:45.253595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 10:14:45.253595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 10:14:45.253595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 10:14:45.253595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 10:14:45.253595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 10:14:45.253595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 10:14:45.253595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 10:14:45.253595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 10:14:45.253595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application conn.query(q) Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application result.read() Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 10:14:45.254504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 10:14:45.255386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 10:14:45.255386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 10:14:45.255386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 10:14:45.255386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 10:14:45.255386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 10:14:45.255386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 10:14:45.255386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 10:14:45.255386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 10:14:45.255386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [parameters: {'id': '5a434d03b135445e978e45854b40cf0d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 10:14:45.255386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 10:14:45.255386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:45.255386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:45.255386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:45.255386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:45.255386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:45.256191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:45.257091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:45.257091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 26 10:14:45.257091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 26 10:14:45.257091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:45.257091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:45.257091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 26 10:14:45.257091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 26 10:14:45.257091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5a434d03b135445e978e45854b40cf0d. Jul 26 10:14:45.257091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:45.257091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 399/797] 10.222.0.60 () {60 vars in 1140 bytes} [Tue Jul 26 10:14:45 2022] POST /identity/v3/projects => generated 262 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:45.257635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dc908-908e-4e25-a05f-a160b1e0f0de None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:45.299011 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:45.309588 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684369b3-021c-4e21-8658-660e4bb863b2 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:45.345038 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583defc-8f54-43c9-a864-4d525c211972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:45.345660 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583defc-8f54-43c9-a864-4d525c211972 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:45.345941 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583defc-8f54-43c9-a864-4d525c211972 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:45.346206 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583defc-8f54-43c9-a864-4d525c211972 None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:45.346935 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583defc-8f54-43c9-a864-4d525c211972 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:45.347236 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583defc-8f54-43c9-a864-4d525c211972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:45.348612 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583defc-8f54-43c9-a864-4d525c211972 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:45.353011 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 399/798] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Jul 26 10:14:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:45.358495 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dc908-908e-4e25-a05f-a160b1e0f0de None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:45.396541 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc9831-aadb-4e2e-a618-45335b895929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:45.397696 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc9831-aadb-4e2e-a618-45335b895929 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:45.397962 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc9831-aadb-4e2e-a618-45335b895929 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:45.398296 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc9831-aadb-4e2e-a618-45335b895929 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:45.406271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc9831-aadb-4e2e-a618-45335b895929 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:45.408030 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc9831-aadb-4e2e-a618-45335b895929 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:45.422584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-f3fc9831-aadb-4e2e-a618-45335b895929 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:45.422584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:45.422584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:45.422584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:45.422584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:45.422584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:45.422584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:45.422584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:45.422584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:45.422584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:45.422584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:45.422584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:45.422584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:14:45.422584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:14:45.422584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:45.423756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:45.424668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:14:45.424668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:14:45.424668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:45.424668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:45.424668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:45.424668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:45.424668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:14:45.424668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:45.424668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 400/799] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:14:45.430558 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583defc-8f54-43c9-a864-4d525c211972 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:45.542368 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583defc-8f54-43c9-a864-4d525c211972 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:45.577942 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f781110-cdc8-4ff4-ae7f-509fe8702f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:45.578594 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f781110-cdc8-4ff4-ae7f-509fe8702f16 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:45.578870 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f781110-cdc8-4ff4-ae7f-509fe8702f16 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:45.579140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f781110-cdc8-4ff4-ae7f-509fe8702f16 None admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:45.579861 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f781110-cdc8-4ff4-ae7f-509fe8702f16 None admin] RBAC: Adding query filter params (name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:45.580163 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f781110-cdc8-4ff4-ae7f-509fe8702f16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:45.583382 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f781110-cdc8-4ff4-ae7f-509fe8702f16 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:45.606962 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 400/800] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Jul 26 10:14:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:47.591118 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923dc9-9e79-45a8-a2d3-38bf09b6240e None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:47.591669 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923dc9-9e79-45a8-a2d3-38bf09b6240e None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:47.591850 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923dc9-9e79-45a8-a2d3-38bf09b6240e None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:47.596128 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 401/801] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:47.602455 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449c5ab-8d2a-4d0a-a2f2-36101aad2912 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:47.602919 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449c5ab-8d2a-4d0a-a2f2-36101aad2912 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:47.603005 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449c5ab-8d2a-4d0a-a2f2-36101aad2912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:47.621667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-e449c5ab-8d2a-4d0a-a2f2-36101aad2912 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:47.622880 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-e449c5ab-8d2a-4d0a-a2f2-36101aad2912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:47.633968 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:47.692892 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 401/802] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:47 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:47.716961 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923dc9-9e79-45a8-a2d3-38bf09b6240e None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:47.752722 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:47.836184 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923dc9-9e79-45a8-a2d3-38bf09b6240e None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:47.873105 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cea9c-7cbc-4bf8-bf1f-80ffd114677e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:47.873656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cea9c-7cbc-4bf8-bf1f-80ffd114677e None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:47.873933 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cea9c-7cbc-4bf8-bf1f-80ffd114677e None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:47.874200 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cea9c-7cbc-4bf8-bf1f-80ffd114677e None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:47.874966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cea9c-7cbc-4bf8-bf1f-80ffd114677e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:47.876347 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cea9c-7cbc-4bf8-bf1f-80ffd114677e None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:47.898784 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 402/803] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Jul 26 10:14:47 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:14:47.899249 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66d83d-e40a-4ef9-a09e-ea054aaad3ff None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:47.899533 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66d83d-e40a-4ef9-a09e-ea054aaad3ff None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:47.899808 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66d83d-e40a-4ef9-a09e-ea054aaad3ff None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:47.901234 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 402/804] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:14:47.908260 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e03de-83a7-44e5-bf0d-9c37d458f995 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:47.908582 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e03de-83a7-44e5-bf0d-9c37d458f995 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:47.908862 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e03de-83a7-44e5-bf0d-9c37d458f995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:47.929571 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-883e03de-83a7-44e5-bf0d-9c37d458f995 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:47.931202 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-883e03de-83a7-44e5-bf0d-9c37d458f995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:48.024346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 403/805] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:47 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:48.050943 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66d83d-e40a-4ef9-a09e-ea054aaad3ff None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:48.158332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66d83d-e40a-4ef9-a09e-ea054aaad3ff None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:48.195500 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0226eb-a41a-46ec-b76b-d31edb33a360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:48.196131 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0226eb-a41a-46ec-b76b-d31edb33a360 None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:48.196414 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0226eb-a41a-46ec-b76b-d31edb33a360 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:48.196674 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0226eb-a41a-46ec-b76b-d31edb33a360 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:48.197390 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0226eb-a41a-46ec-b76b-d31edb33a360 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:48.198931 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0226eb-a41a-46ec-b76b-d31edb33a360 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:48.201567 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: WARNING keystone.server.flask.common [None req-7e0226eb-a41a-46ec-b76b-d31edb33a360 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 10:14:48.214860 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.sql.core [None req-7e0226eb-a41a-46ec-b76b-d31edb33a360 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 10:14:48.214860 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 10:14:48.214860 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [parameters: {'user_id': '80e39b0219104ef1a12a390a498044e7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 10:14:48.214860 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87124) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 10:14:48.231078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-7e0226eb-a41a-46ec-b76b-d31edb33a360 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 10:14:48.231078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:48.231078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 10:14:48.231078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 10:14:48.231078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 10:14:48.231078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 10:14:48.231078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 10:14:48.231078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 10:14:48.231078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 10:14:48.231078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application conn.query(q) Jul 26 10:14:48.231078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 10:14:48.231078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 10:14:48.231078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 10:14:48.231078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application result.read() Jul 26 10:14:48.231078 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 10:14:48.232061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application next(self.gen) Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application yield resource Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application next(self.gen) Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise self.value Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application session.commit() Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 10:14:48.233310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self.session.flush() Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application compat.raise_( Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 10:14:48.234463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 10:14:48.235373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application conn.query(q) Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application result.read() Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 10:14:48.236251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 10:14:48.237065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 10:14:48.237065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 10:14:48.237065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 10:14:48.237065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 10:14:48.237065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 10:14:48.237065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 10:14:48.237065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [parameters: {'user_id': '80e39b0219104ef1a12a390a498044e7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 10:14:48.237065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 10:14:48.237065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:48.237065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:48.237065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:48.237065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:48.237065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:48.237065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:48.237065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 26 10:14:48.238698 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 26 10:14:48.239864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 26 10:14:48.239864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 26 10:14:48.239864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 10:14:48.239864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 10:14:48.239864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 10:14:48.239864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:48.239864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 403/806] 10.222.0.60 () {60 vars in 1131 bytes} [Tue Jul 26 10:14:48 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:48.240386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e03de-83a7-44e5-bf0d-9c37d458f995 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:48.254145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:48.346078 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e03de-83a7-44e5-bf0d-9c37d458f995 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:48.382232 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc8c2c-f2e6-4f94-a272-da51d7e9669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:48.382916 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8c2c-f2e6-4f94-a272-da51d7e9669a None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:48.383191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8c2c-f2e6-4f94-a272-da51d7e9669a None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:48.383497 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8c2c-f2e6-4f94-a272-da51d7e9669a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:48.391443 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc8c2c-f2e6-4f94-a272-da51d7e9669a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:48.392890 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc8c2c-f2e6-4f94-a272-da51d7e9669a None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-27dc8c2c-f2e6-4f94-a272-da51d7e9669a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:14:48.404619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:48.405655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:48.406641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:48.406641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:48.406641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:14:48.406641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:14:48.406641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:14:48.406641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:14:48.406641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:14:48.406641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:14:48.406641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:14:48.406641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:48.406641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 404/807] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:48.412479 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0226eb-a41a-46ec-b76b-d31edb33a360 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:48.422848 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:48.522190 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0226eb-a41a-46ec-b76b-d31edb33a360 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:48.557600 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc8e93-ec7c-407c-b25d-4c798b59ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:48.558239 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc8e93-ec7c-407c-b25d-4c798b59ab10 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:48.558537 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc8e93-ec7c-407c-b25d-4c798b59ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:48.558812 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc8e93-ec7c-407c-b25d-4c798b59ab10 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:48.559596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc8e93-ec7c-407c-b25d-4c798b59ab10 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:48.559899 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc8e93-ec7c-407c-b25d-4c798b59ab10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:48.561679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc8e93-ec7c-407c-b25d-4c798b59ab10 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:48.604855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 404/808] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Jul 26 10:14:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:14:50.168917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0620b2-094f-41eb-8790-e382216a818b None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:50.169813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0620b2-094f-41eb-8790-e382216a818b None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:50.169813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0620b2-094f-41eb-8790-e382216a818b None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:50.172013 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 405/809] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:50.180918 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05de35d-6ca8-41c7-95c7-5684dcb43761 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:50.181338 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05de35d-6ca8-41c7-95c7-5684dcb43761 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:50.181516 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05de35d-6ca8-41c7-95c7-5684dcb43761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:50.207366 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-b05de35d-6ca8-41c7-95c7-5684dcb43761 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:50.208918 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-b05de35d-6ca8-41c7-95c7-5684dcb43761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:50.291819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:50.301541 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 405/810] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:50 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:50.325677 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0620b2-094f-41eb-8790-e382216a818b None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:50.409770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:50.439400 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0620b2-094f-41eb-8790-e382216a818b None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:50.486077 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e573097-a3c2-4274-9cac-6514fe20ac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:50.486762 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e573097-a3c2-4274-9cac-6514fe20ac60 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:50.487043 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e573097-a3c2-4274-9cac-6514fe20ac60 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:50.487318 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e573097-a3c2-4274-9cac-6514fe20ac60 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:50.487958 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e573097-a3c2-4274-9cac-6514fe20ac60 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:50.489339 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e573097-a3c2-4274-9cac-6514fe20ac60 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-0e573097-a3c2-4274-9cac-6514fe20ac60 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:50.498797 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:50.500023 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:50.501085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:50.501085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:50.501085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:50.501085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:50.501085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:50.501085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:50.501085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:50.501085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:50.501085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:50.501085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:50.501085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:50.501085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:50.501085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:14:50.501085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:14:50.501085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 406/811] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:50.506425 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05de35d-6ca8-41c7-95c7-5684dcb43761 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:50.619929 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05de35d-6ca8-41c7-95c7-5684dcb43761 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:50.654902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7b611-3d4f-4d0d-8bf0-bde6b6a5ba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:50.655526 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7b611-3d4f-4d0d-8bf0-bde6b6a5ba3b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:50.655805 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7b611-3d4f-4d0d-8bf0-bde6b6a5ba3b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:50.656075 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7b611-3d4f-4d0d-8bf0-bde6b6a5ba3b None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:50.656759 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7b611-3d4f-4d0d-8bf0-bde6b6a5ba3b None admin] RBAC: Adding query filter params (name=compute) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:50.657063 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7b611-3d4f-4d0d-8bf0-bde6b6a5ba3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:50.658473 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7b611-3d4f-4d0d-8bf0-bde6b6a5ba3b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:50.664019 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 406/812] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Jul 26 10:14:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:50.673207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e573097-a3c2-4274-9cac-6514fe20ac60 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:50.778393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e573097-a3c2-4274-9cac-6514fe20ac60 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:50.817512 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09785f0-d3ca-4afc-af91-4a7898540cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:50.818114 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09785f0-d3ca-4afc-af91-4a7898540cb8 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:50.818387 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09785f0-d3ca-4afc-af91-4a7898540cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:50.818685 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09785f0-d3ca-4afc-af91-4a7898540cb8 None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:50.819355 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09785f0-d3ca-4afc-af91-4a7898540cb8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:50.819648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09785f0-d3ca-4afc-af91-4a7898540cb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:50.820986 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09785f0-d3ca-4afc-af91-4a7898540cb8 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:50.826459 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 407/813] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Jul 26 10:14:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:50.833372 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7b611-3d4f-4d0d-8bf0-bde6b6a5ba3b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:50.911726 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:50.957630 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7b611-3d4f-4d0d-8bf0-bde6b6a5ba3b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:50.997404 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b83657-721b-4b73-b9bd-6bf8fc1d457c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:50.998024 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b83657-721b-4b73-b9bd-6bf8fc1d457c None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:50.998297 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b83657-721b-4b73-b9bd-6bf8fc1d457c None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:50.998601 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b83657-721b-4b73-b9bd-6bf8fc1d457c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:50.999364 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b83657-721b-4b73-b9bd-6bf8fc1d457c None admin] RBAC: Adding query filter params (interface=public, service_id=e52e6cfe29a44162997d65e725c5ec42, region_id=RegionOne) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:50.999668 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b83657-721b-4b73-b9bd-6bf8fc1d457c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:51.001057 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b83657-721b-4b73-b9bd-6bf8fc1d457c None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:51.006571 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 407/814] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Jul 26 10:14:50 2022] GET /identity/v3/endpoints?service_id=e52e6cfe29a44162997d65e725c5ec42&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:51.012672 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09785f0-d3ca-4afc-af91-4a7898540cb8 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:51.015736 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:51.121537 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09785f0-d3ca-4afc-af91-4a7898540cb8 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:51.159998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e189fbe-8110-4025-b656-0100b2f105f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:51.161269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e189fbe-8110-4025-b656-0100b2f105f7 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:51.161600 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e189fbe-8110-4025-b656-0100b2f105f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:51.161985 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e189fbe-8110-4025-b656-0100b2f105f7 None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:51.162920 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e189fbe-8110-4025-b656-0100b2f105f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:51.165090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e189fbe-8110-4025-b656-0100b2f105f7 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:51.172350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 408/815] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Jul 26 10:14:51 2022] GET /identity/v3/services => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:14:53.408288 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2264d-3a8c-49dd-850d-58f5bfd6e71c None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:53.409144 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2264d-3a8c-49dd-850d-58f5bfd6e71c None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:53.409144 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2264d-3a8c-49dd-850d-58f5bfd6e71c None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:53.411666 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 408/816] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:14:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:53.418303 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c673784-4915-43ed-9007-479f3451f7d9 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:53.419085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c673784-4915-43ed-9007-479f3451f7d9 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:53.419209 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c673784-4915-43ed-9007-479f3451f7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:53.449174 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-3c673784-4915-43ed-9007-479f3451f7d9 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:53.450371 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-3c673784-4915-43ed-9007-479f3451f7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:53.517917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:53.528217 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 409/817] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:53 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:53.552961 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2264d-3a8c-49dd-850d-58f5bfd6e71c None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:53.678532 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2264d-3a8c-49dd-850d-58f5bfd6e71c None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:53.706736 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:53.721411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bb429-1738-45a9-9ca1-b5284fe4febd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:53.722070 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bb429-1738-45a9-9ca1-b5284fe4febd None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:53.722347 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bb429-1738-45a9-9ca1-b5284fe4febd None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:53.722735 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bb429-1738-45a9-9ca1-b5284fe4febd None admin] PATH_INFO: `/v3/services/compute` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:53.723291 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1bb429-1738-45a9-9ca1-b5284fe4febd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:53.724681 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1bb429-1738-45a9-9ca1-b5284fe4febd None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-6f1bb429-1738-45a9-9ca1-b5284fe4febd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:53.733766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:53.734902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:53.735729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:53.735729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:53.735729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:53.735729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:53.735729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:53.735729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:53.735729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:53.735729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:53.735729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:53.735729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:53.735729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:14:53.735729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:14:53.735729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:14:53.735729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:14:53.735729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 409/818] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:14:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:53.741577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c673784-4915-43ed-9007-479f3451f7d9 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:53.849650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c673784-4915-43ed-9007-479f3451f7d9 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:53.885905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679f8dc-7d48-4fe4-acc1-4ff23b8d1ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:53.886594 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679f8dc-7d48-4fe4-acc1-4ff23b8d1ddc None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:53.886876 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679f8dc-7d48-4fe4-acc1-4ff23b8d1ddc None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:53.887155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679f8dc-7d48-4fe4-acc1-4ff23b8d1ddc None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:53.887846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679f8dc-7d48-4fe4-acc1-4ff23b8d1ddc None admin] RBAC: Adding query filter params (name=compute) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:53.888147 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679f8dc-7d48-4fe4-acc1-4ff23b8d1ddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:53.889718 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679f8dc-7d48-4fe4-acc1-4ff23b8d1ddc None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:53.895203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 410/819] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Jul 26 10:14:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:53.901542 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bb429-1738-45a9-9ca1-b5284fe4febd None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:54.017532 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bb429-1738-45a9-9ca1-b5284fe4febd None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:54.055094 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047c7e6-a8fc-44e0-ae0b-1b3f410ac9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:54.055763 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047c7e6-a8fc-44e0-ae0b-1b3f410ac9f1 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:54.056134 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047c7e6-a8fc-44e0-ae0b-1b3f410ac9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:54.056528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047c7e6-a8fc-44e0-ae0b-1b3f410ac9f1 None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:54.057374 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047c7e6-a8fc-44e0-ae0b-1b3f410ac9f1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:54.057787 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047c7e6-a8fc-44e0-ae0b-1b3f410ac9f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:54.059223 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047c7e6-a8fc-44e0-ae0b-1b3f410ac9f1 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:54.065231 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 410/820] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Jul 26 10:14:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:54.072978 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679f8dc-7d48-4fe4-acc1-4ff23b8d1ddc None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:54.132299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:54.175273 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679f8dc-7d48-4fe4-acc1-4ff23b8d1ddc None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:54.211825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a9183-bb6d-4e92-823e-523c67126038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:54.212447 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a9183-bb6d-4e92-823e-523c67126038 None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:54.212766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a9183-bb6d-4e92-823e-523c67126038 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:54.212983 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a9183-bb6d-4e92-823e-523c67126038 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:54.213700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a9183-bb6d-4e92-823e-523c67126038 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:54.215134 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a9183-bb6d-4e92-823e-523c67126038 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:54.242018 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 411/821] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Jul 26 10:14:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:15:04.062286 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=75 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:04.234612 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:56.461616 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92110021-9a65-4439-af91-771e397c6bfa None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:56.462278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92110021-9a65-4439-af91-771e397c6bfa None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:56.462278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92110021-9a65-4439-af91-771e397c6bfa None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:56.463873 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 411/822] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:15:56.469863 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1168e-c747-4ab0-a286-80530bd6ac58 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:56.470469 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1168e-c747-4ab0-a286-80530bd6ac58 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:56.470469 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1168e-c747-4ab0-a286-80530bd6ac58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:56.495218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-8eb1168e-c747-4ab0-a286-80530bd6ac58 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:15:56.497264 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-8eb1168e-c747-4ab0-a286-80530bd6ac58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:15:56.613249 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 412/823] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:15:56 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:15:56.649232 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92110021-9a65-4439-af91-771e397c6bfa None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:56.786170 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92110021-9a65-4439-af91-771e397c6bfa None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:56.830386 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea957474-7891-43f9-ab7e-37d9142d1732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:56.831077 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea957474-7891-43f9-ab7e-37d9142d1732 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:56.831360 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea957474-7891-43f9-ab7e-37d9142d1732 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:56.831637 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea957474-7891-43f9-ab7e-37d9142d1732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:56.851480 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea957474-7891-43f9-ab7e-37d9142d1732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:56.854061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea957474-7891-43f9-ab7e-37d9142d1732 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:56.886409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-ea957474-7891-43f9-ab7e-37d9142d1732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:56.886409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:56.886409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:56.886409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:56.886409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:56.886409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:56.886409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:56.886409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:56.886409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:56.886409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:56.886409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:56.886409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:56.886409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:15:56.886409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:15:56.886409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:56.888902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:56.890708 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:15:56.890708 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:15:56.890708 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:56.890708 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:15:56.890708 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 412/824] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:15:56.895088 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1168e-c747-4ab0-a286-80530bd6ac58 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:57.031214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1168e-c747-4ab0-a286-80530bd6ac58 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:57.067404 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:57.077538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0073ca5-8e7e-4e54-a817-ef5559e95cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:57.078202 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0073ca5-8e7e-4e54-a817-ef5559e95cd9 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:57.078557 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0073ca5-8e7e-4e54-a817-ef5559e95cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:57.078810 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0073ca5-8e7e-4e54-a817-ef5559e95cd9 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:57.079682 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0073ca5-8e7e-4e54-a817-ef5559e95cd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:57.080114 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0073ca5-8e7e-4e54-a817-ef5559e95cd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:57.081796 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0073ca5-8e7e-4e54-a817-ef5559e95cd9 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:57.096181 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 413/825] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:57.102566 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea957474-7891-43f9-ab7e-37d9142d1732 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:57.184208 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:57.234825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea957474-7891-43f9-ab7e-37d9142d1732 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:57.286355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dfbb9-2c68-4324-b461-d42f94b43dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:57.287026 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dfbb9-2c68-4324-b461-d42f94b43dc2 None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:57.287308 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dfbb9-2c68-4324-b461-d42f94b43dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:57.287596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dfbb9-2c68-4324-b461-d42f94b43dc2 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:57.288321 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105dfbb9-2c68-4324-b461-d42f94b43dc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:57.289767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105dfbb9-2c68-4324-b461-d42f94b43dc2 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:57.388515 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 413/826] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Jul 26 10:15:57 2022] POST /identity/v3/users => generated 251 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:16:00.242322 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a1116-00f7-46b2-95d1-2bff1576dfa2 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:00.243495 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a1116-00f7-46b2-95d1-2bff1576dfa2 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:00.243495 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a1116-00f7-46b2-95d1-2bff1576dfa2 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:00.244365 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 414/827] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:16:00.250727 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1e49d-a725-4c72-a5ad-75375b989937 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:00.251267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1e49d-a725-4c72-a5ad-75375b989937 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:00.251376 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1e49d-a725-4c72-a5ad-75375b989937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:00.272835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-99a1e49d-a725-4c72-a5ad-75375b989937 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:16:00.273979 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-99a1e49d-a725-4c72-a5ad-75375b989937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:16:00.353494 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 414/828] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:16:00 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:16:00.382442 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a1116-00f7-46b2-95d1-2bff1576dfa2 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:00.502332 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a1116-00f7-46b2-95d1-2bff1576dfa2 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:00.543089 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76036112-dde5-4f1c-8234-88ee044ffc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:00.543820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76036112-dde5-4f1c-8234-88ee044ffc5e None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:00.544280 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76036112-dde5-4f1c-8234-88ee044ffc5e None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:00.544733 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76036112-dde5-4f1c-8234-88ee044ffc5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:00.557158 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76036112-dde5-4f1c-8234-88ee044ffc5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-76036112-dde5-4f1c-8234-88ee044ffc5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:16:00.562230 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:00.571429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:00.574336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:00.574336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:00.574336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:00.574336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:00.574336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:16:00.574336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:16:00.574336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:16:00.574336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:16:00.574336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:16:00.574336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:16:00.574336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:16:00.574336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:00.574336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 415/829] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:16:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:00.576285 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1e49d-a725-4c72-a5ad-75375b989937 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:00.619015 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:00.697364 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1e49d-a725-4c72-a5ad-75375b989937 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:00.739069 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2965f-8e2b-472f-a330-1ffbc88df1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:00.740429 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2965f-8e2b-472f-a330-1ffbc88df1ec None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:00.740592 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2965f-8e2b-472f-a330-1ffbc88df1ec None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:00.741010 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2965f-8e2b-472f-a330-1ffbc88df1ec None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:00.742027 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2965f-8e2b-472f-a330-1ffbc88df1ec None admin] RBAC: Adding query filter params (name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:00.742647 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2965f-8e2b-472f-a330-1ffbc88df1ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:00.744169 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2965f-8e2b-472f-a330-1ffbc88df1ec None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:00.753599 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 415/830] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Jul 26 10:16:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:00.760250 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76036112-dde5-4f1c-8234-88ee044ffc5e None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:00.816122 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:00.877651 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76036112-dde5-4f1c-8234-88ee044ffc5e None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:00.917596 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780cedf-5da8-49b8-a6d4-d72fe90d2b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:00.919213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780cedf-5da8-49b8-a6d4-d72fe90d2b6c None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:00.919213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780cedf-5da8-49b8-a6d4-d72fe90d2b6c None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:00.919213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780cedf-5da8-49b8-a6d4-d72fe90d2b6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:00.931939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780cedf-5da8-49b8-a6d4-d72fe90d2b6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:00.933854 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780cedf-5da8-49b8-a6d4-d72fe90d2b6c None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:00.951915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-f780cedf-5da8-49b8-a6d4-d72fe90d2b6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:00.951915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:00.951915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:00.951915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:00.951915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:00.951915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:00.951915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:00.951915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:00.951915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:00.951915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:00.951915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:00.951915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:00.951915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:16:00.951915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:16:00.951915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:00.953382 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:00.954852 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:16:00.954852 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:16:00.954852 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:00.954852 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:00.954852 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 416/831] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:00.963288 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2965f-8e2b-472f-a330-1ffbc88df1ec None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:01.099898 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:01.102908 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2965f-8e2b-472f-a330-1ffbc88df1ec None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:01.150307 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acc13f-d61b-4fd3-b66f-ca06ff088a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:01.151003 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc13f-d61b-4fd3-b66f-ca06ff088a03 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:01.151280 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc13f-d61b-4fd3-b66f-ca06ff088a03 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:01.151548 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc13f-d61b-4fd3-b66f-ca06ff088a03 None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:01.152251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acc13f-d61b-4fd3-b66f-ca06ff088a03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:01.152553 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acc13f-d61b-4fd3-b66f-ca06ff088a03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:01.153998 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acc13f-d61b-4fd3-b66f-ca06ff088a03 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:01.168727 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 416/832] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:01.175574 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780cedf-5da8-49b8-a6d4-d72fe90d2b6c None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:01.300499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:01.307145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780cedf-5da8-49b8-a6d4-d72fe90d2b6c None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:01.361074 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab5916-494f-4345-9fc1-cec3f089f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:01.361074 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab5916-494f-4345-9fc1-cec3f089f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:01.361429 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab5916-494f-4345-9fc1-cec3f089f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:01.361716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab5916-494f-4345-9fc1-cec3f089f6f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:01.372673 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab5916-494f-4345-9fc1-cec3f089f6f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:01.375189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab5916-494f-4345-9fc1-cec3f089f6f0 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-f5ab5916-494f-4345-9fc1-cec3f089f6f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:16:01.393121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:01.394350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:01.395564 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:01.395564 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:01.395564 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:16:01.395564 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:16:01.395564 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:16:01.395564 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:16:01.395564 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:16:01.395564 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:16:01.395564 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:01.395564 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:01.395564 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 417/833] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:01.410130 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acc13f-d61b-4fd3-b66f-ca06ff088a03 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:01.563500 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acc13f-d61b-4fd3-b66f-ca06ff088a03 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:01.611228 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823ed01-807e-424d-ba6a-6cdf0ecf67ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:01.611782 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823ed01-807e-424d-ba6a-6cdf0ecf67ad None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:01.612056 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823ed01-807e-424d-ba6a-6cdf0ecf67ad None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:01.612327 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823ed01-807e-424d-ba6a-6cdf0ecf67ad None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:01.613139 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823ed01-807e-424d-ba6a-6cdf0ecf67ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:01.613442 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823ed01-807e-424d-ba6a-6cdf0ecf67ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:01.614941 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823ed01-807e-424d-ba6a-6cdf0ecf67ad None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:01.638513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 417/834] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Jul 26 10:16:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:01.645224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab5916-494f-4345-9fc1-cec3f089f6f0 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:01.786777 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab5916-494f-4345-9fc1-cec3f089f6f0 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:01.834340 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616f368-5c10-457c-8bb6-b3947d7ac2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:01.835880 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616f368-5c10-457c-8bb6-b3947d7ac2c5 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:01.835993 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616f368-5c10-457c-8bb6-b3947d7ac2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:01.836339 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616f368-5c10-457c-8bb6-b3947d7ac2c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:01.876945 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:01.929404 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616f368-5c10-457c-8bb6-b3947d7ac2c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:01.931095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616f368-5c10-457c-8bb6-b3947d7ac2c5 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:02.056608 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 418/835] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:16:01 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:16:02.063494 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823ed01-807e-424d-ba6a-6cdf0ecf67ad None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:02.091773 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:02.198742 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823ed01-807e-424d-ba6a-6cdf0ecf67ad None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:02.247817 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aea8c5-0036-48f9-8761-0ae7e0c315a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:02.248468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aea8c5-0036-48f9-8761-0ae7e0c315a5 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:02.248840 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aea8c5-0036-48f9-8761-0ae7e0c315a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:02.248999 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aea8c5-0036-48f9-8761-0ae7e0c315a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:02.260150 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aea8c5-0036-48f9-8761-0ae7e0c315a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:02.262045 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aea8c5-0036-48f9-8761-0ae7e0c315a5 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:02.280427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-b2aea8c5-0036-48f9-8761-0ae7e0c315a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:02.280427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:02.280427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:02.280427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:02.280427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:02.280427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:02.280427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:02.280427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:02.280427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:02.280427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:02.280427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:02.280427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:02.280427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:16:02.280427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:16:02.280427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:02.281679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:02.283182 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:16:02.283182 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:16:02.283182 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:02.283182 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:16:02.283182 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 418/836] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:02.288769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616f368-5c10-457c-8bb6-b3947d7ac2c5 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:02.373226 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:02.438762 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616f368-5c10-457c-8bb6-b3947d7ac2c5 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:02.480710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b5cb1-6a2e-4f8a-a1fb-cca5004b86f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:02.481302 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b5cb1-6a2e-4f8a-a1fb-cca5004b86f5 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:02.481583 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b5cb1-6a2e-4f8a-a1fb-cca5004b86f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:02.481859 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b5cb1-6a2e-4f8a-a1fb-cca5004b86f5 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:02.482643 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b5cb1-6a2e-4f8a-a1fb-cca5004b86f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:02.482966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b5cb1-6a2e-4f8a-a1fb-cca5004b86f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:02.484756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b5cb1-6a2e-4f8a-a1fb-cca5004b86f5 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:02.505492 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 419/837] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:16:02.506797 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aea8c5-0036-48f9-8761-0ae7e0c315a5 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:02.605001 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:02.643419 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aea8c5-0036-48f9-8761-0ae7e0c315a5 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:02.686276 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c15b66-20cb-497a-a5b1-6fe58f102efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:02.686981 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c15b66-20cb-497a-a5b1-6fe58f102efd None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:02.687265 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c15b66-20cb-497a-a5b1-6fe58f102efd None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:02.687541 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c15b66-20cb-497a-a5b1-6fe58f102efd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:02.701916 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c15b66-20cb-497a-a5b1-6fe58f102efd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:02.703825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c15b66-20cb-497a-a5b1-6fe58f102efd None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:02.719187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-51c15b66-20cb-497a-a5b1-6fe58f102efd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:02.719187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:02.719187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:02.719187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:02.719187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:02.719187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:02.719187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:02.719187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:02.719187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:02.719187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:02.719187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:02.719187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:02.719187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:16:02.719187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:16:02.719187 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:02.721278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:02.723160 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:16:02.723160 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:16:02.723160 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:16:02.723160 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:16:02.723160 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:16:02.723160 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:16:02.723160 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:02.723160 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:16:02.723160 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 419/838] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:16:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:16:02.726836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b5cb1-6a2e-4f8a-a1fb-cca5004b86f5 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:02.851180 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b5cb1-6a2e-4f8a-a1fb-cca5004b86f5 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:02.871950 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:02.892072 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5c92d-3d01-426d-9328-34abbe1af75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:02.892852 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5c92d-3d01-426d-9328-34abbe1af75b None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:02.893266 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5c92d-3d01-426d-9328-34abbe1af75b None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:02.893627 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5c92d-3d01-426d-9328-34abbe1af75b None admin] PATH_INFO: `/v3/projects` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:02.894553 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5c92d-3d01-426d-9328-34abbe1af75b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:02.894778 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5c92d-3d01-426d-9328-34abbe1af75b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:02.896234 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5c92d-3d01-426d-9328-34abbe1af75b None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:02.912290 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 420/839] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:16:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:16:02.918885 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c15b66-20cb-497a-a5b1-6fe58f102efd None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:03.036260 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c15b66-20cb-497a-a5b1-6fe58f102efd None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:03.072181 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:03.079413 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38271ad-129f-444b-976c-4575d04cb892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:03.080055 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38271ad-129f-444b-976c-4575d04cb892 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:03.081128 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38271ad-129f-444b-976c-4575d04cb892 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:03.081128 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38271ad-129f-444b-976c-4575d04cb892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:03.081510 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38271ad-129f-444b-976c-4575d04cb892 None admin] RBAC: Adding query filter params (role.id=81782254e8c2428284b8181e87647f8a, scope.project.id=6897068dc29445f7878c7c12a0915d48, user.id=32a61a4fe5c74444af1afdbeaf9be512) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:03.081804 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38271ad-129f-444b-976c-4575d04cb892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:03.083303 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38271ad-129f-444b-976c-4575d04cb892 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:03.090294 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 420/840] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:16:02 2022] GET /identity/v3/role_assignments?user.id=32a61a4fe5c74444af1afdbeaf9be512&scope.project.id=6897068dc29445f7878c7c12a0915d48&role.id=81782254e8c2428284b8181e87647f8a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:05.517428 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c4726-a0f1-4875-8f77-64a4f31e96b0 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:05.518013 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c4726-a0f1-4875-8f77-64a4f31e96b0 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:05.518013 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c4726-a0f1-4875-8f77-64a4f31e96b0 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:05.519372 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 421/841] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:16:05.526926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12367fa1-b578-4e01-b55c-d8dea66e68dd None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:05.527428 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12367fa1-b578-4e01-b55c-d8dea66e68dd None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:05.527517 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12367fa1-b578-4e01-b55c-d8dea66e68dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:05.546710 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-12367fa1-b578-4e01-b55c-d8dea66e68dd None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:16:05.547911 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-12367fa1-b578-4e01-b55c-d8dea66e68dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:16:05.630541 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 421/842] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:16:05 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:16:05.650070 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c4726-a0f1-4875-8f77-64a4f31e96b0 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:05.778098 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c4726-a0f1-4875-8f77-64a4f31e96b0 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:05.826944 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce76fb-c022-4c95-a23d-527fcd8226ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:05.827587 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce76fb-c022-4c95-a23d-527fcd8226ac None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:05.827866 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce76fb-c022-4c95-a23d-527fcd8226ac None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:05.828200 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce76fb-c022-4c95-a23d-527fcd8226ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:05.839699 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce76fb-c022-4c95-a23d-527fcd8226ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-1fce76fb-c022-4c95-a23d-527fcd8226ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:16:05.844970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:05.845952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:05.847214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:05.847214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:05.847214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:05.847214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:05.847214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:16:05.847214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:16:05.847214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:16:05.847214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:16:05.847214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:16:05.847214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:16:05.847214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:16:05.847214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:05.847214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 422/843] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:16:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:05.852904 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12367fa1-b578-4e01-b55c-d8dea66e68dd None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:05.972305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12367fa1-b578-4e01-b55c-d8dea66e68dd None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:05.998825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:06.016425 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e7612-d996-4e09-8356-af6e85efc1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:06.017136 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e7612-d996-4e09-8356-af6e85efc1c4 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:06.017449 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e7612-d996-4e09-8356-af6e85efc1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:06.017752 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e7612-d996-4e09-8356-af6e85efc1c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:06.018726 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e7612-d996-4e09-8356-af6e85efc1c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:06.018817 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e7612-d996-4e09-8356-af6e85efc1c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:06.020368 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e7612-d996-4e09-8356-af6e85efc1c4 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:06.030102 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 422/844] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Jul 26 10:16:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:06.036778 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce76fb-c022-4c95-a23d-527fcd8226ac None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:06.082641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:06.155340 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce76fb-c022-4c95-a23d-527fcd8226ac None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:06.195670 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce785375-c328-4f48-b20b-5a6c277b4712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:06.196642 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce785375-c328-4f48-b20b-5a6c277b4712 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:06.197113 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce785375-c328-4f48-b20b-5a6c277b4712 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:06.197496 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce785375-c328-4f48-b20b-5a6c277b4712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:06.212293 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce785375-c328-4f48-b20b-5a6c277b4712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:06.213826 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce785375-c328-4f48-b20b-5a6c277b4712 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:06.230749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-ce785375-c328-4f48-b20b-5a6c277b4712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:06.230749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:06.230749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:06.230749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:06.230749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:06.230749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:06.230749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:06.230749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:06.230749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:06.230749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:06.230749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:06.230749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:06.230749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:16:06.230749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:16:06.230749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:06.232182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:06.235905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:16:06.235905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:16:06.235905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:06.235905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:06.235905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 423/845] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:06.238564 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e7612-d996-4e09-8356-af6e85efc1c4 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:06.363370 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e7612-d996-4e09-8356-af6e85efc1c4 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:06.408382 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf27347-38e6-44e1-869c-46fb19a014ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:06.409170 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf27347-38e6-44e1-869c-46fb19a014ed None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:06.409589 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf27347-38e6-44e1-869c-46fb19a014ed None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:06.410028 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf27347-38e6-44e1-869c-46fb19a014ed None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:06.410823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf27347-38e6-44e1-869c-46fb19a014ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:06.411134 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf27347-38e6-44e1-869c-46fb19a014ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:06.412559 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf27347-38e6-44e1-869c-46fb19a014ed None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:06.430855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 423/846] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:06.436626 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce785375-c328-4f48-b20b-5a6c277b4712 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:06.541418 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:06.552527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce785375-c328-4f48-b20b-5a6c277b4712 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:06.606203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8dc4b-467d-47ec-a281-cb4f7e98856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:06.607102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8dc4b-467d-47ec-a281-cb4f7e98856f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:06.607439 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8dc4b-467d-47ec-a281-cb4f7e98856f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:06.607814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8dc4b-467d-47ec-a281-cb4f7e98856f None admin] PATH_INFO: `/v3/users/placement` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:06.615784 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8dc4b-467d-47ec-a281-cb4f7e98856f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:06.617698 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8dc4b-467d-47ec-a281-cb4f7e98856f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-b9c8dc4b-467d-47ec-a281-cb4f7e98856f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:16:06.635016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:06.636299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:06.637393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:06.637393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:06.637393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:16:06.637393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:16:06.637393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:16:06.637393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:16:06.637393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:16:06.637393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:16:06.637393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:06.637393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:06.637393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 424/847] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:06.642515 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf27347-38e6-44e1-869c-46fb19a014ed None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:06.701400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:06.767039 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf27347-38e6-44e1-869c-46fb19a014ed None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:06.808624 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40568324-70d2-4aa3-a5cd-6f43421d1977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:06.809355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40568324-70d2-4aa3-a5cd-6f43421d1977 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:06.809702 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40568324-70d2-4aa3-a5cd-6f43421d1977 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:06.810003 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40568324-70d2-4aa3-a5cd-6f43421d1977 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:06.811041 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40568324-70d2-4aa3-a5cd-6f43421d1977 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:06.811417 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40568324-70d2-4aa3-a5cd-6f43421d1977 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:06.812928 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40568324-70d2-4aa3-a5cd-6f43421d1977 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:06.832412 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 424/848] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Jul 26 10:16:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:16:06.838554 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8dc4b-467d-47ec-a281-cb4f7e98856f None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:06.959427 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8dc4b-467d-47ec-a281-cb4f7e98856f None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:07.001641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cfd42-3cd8-42b3-b4da-0fd53d7cc352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:07.003156 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cfd42-3cd8-42b3-b4da-0fd53d7cc352 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:07.003450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cfd42-3cd8-42b3-b4da-0fd53d7cc352 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:07.003691 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cfd42-3cd8-42b3-b4da-0fd53d7cc352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:07.019514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cfd42-3cd8-42b3-b4da-0fd53d7cc352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:07.021548 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cfd42-3cd8-42b3-b4da-0fd53d7cc352 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:07.040112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-5a0cfd42-3cd8-42b3-b4da-0fd53d7cc352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:07.040112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:07.040112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:07.040112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:07.040112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:07.040112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:07.040112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:07.040112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:07.040112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:07.040112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:07.040112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:07.040112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:07.040112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:16:07.040112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:16:07.040112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:07.041208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:07.046987 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:16:07.046987 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:16:07.046987 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:07.046987 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:07.046987 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 425/849] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:07.048522 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40568324-70d2-4aa3-a5cd-6f43421d1977 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:07.164738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40568324-70d2-4aa3-a5cd-6f43421d1977 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:07.167289 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:07.210086 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcdf9a-a69a-4bef-9ff0-6c5c7ebe6b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:07.210664 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcdf9a-a69a-4bef-9ff0-6c5c7ebe6b36 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:07.210942 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcdf9a-a69a-4bef-9ff0-6c5c7ebe6b36 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:07.211211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcdf9a-a69a-4bef-9ff0-6c5c7ebe6b36 None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:07.211983 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcdf9a-a69a-4bef-9ff0-6c5c7ebe6b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:07.212287 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcdf9a-a69a-4bef-9ff0-6c5c7ebe6b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:07.213673 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcdf9a-a69a-4bef-9ff0-6c5c7ebe6b36 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:07.228906 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 425/850] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:16:07.234814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cfd42-3cd8-42b3-b4da-0fd53d7cc352 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:07.240105 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:07.371253 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cfd42-3cd8-42b3-b4da-0fd53d7cc352 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:07.416056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a3978-337c-4c42-af19-4ea08362c967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:07.416715 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a3978-337c-4c42-af19-4ea08362c967 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:07.416996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a3978-337c-4c42-af19-4ea08362c967 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:07.417265 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a3978-337c-4c42-af19-4ea08362c967 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:07.427195 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a3978-337c-4c42-af19-4ea08362c967 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:07.428837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a3978-337c-4c42-af19-4ea08362c967 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:07.442917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-e12a3978-337c-4c42-af19-4ea08362c967 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:07.442917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:07.442917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:07.442917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:07.442917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:07.442917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:07.442917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:07.442917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:07.442917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:07.442917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:07.442917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:07.442917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:07.442917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:16:07.442917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:16:07.442917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:07.444086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:07.445165 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:16:07.445165 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:16:07.445165 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:16:07.445165 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:16:07.445165 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:16:07.445165 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:16:07.445165 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:07.445165 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:07.446515 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 426/851] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:16:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:07.452079 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcdf9a-a69a-4bef-9ff0-6c5c7ebe6b36 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:07.573797 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcdf9a-a69a-4bef-9ff0-6c5c7ebe6b36 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:07.616947 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f50efb-56de-42b6-bf6b-4dc95158eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:07.617595 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f50efb-56de-42b6-bf6b-4dc95158eb78 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:07.617880 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f50efb-56de-42b6-bf6b-4dc95158eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:07.618299 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f50efb-56de-42b6-bf6b-4dc95158eb78 None admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:07.619251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f50efb-56de-42b6-bf6b-4dc95158eb78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:07.619429 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f50efb-56de-42b6-bf6b-4dc95158eb78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:07.620996 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f50efb-56de-42b6-bf6b-4dc95158eb78 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:07.637508 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 426/852] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:16:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:16:07.643880 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a3978-337c-4c42-af19-4ea08362c967 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:07.725480 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:07.769340 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a3978-337c-4c42-af19-4ea08362c967 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:07.805072 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49f18b-e97c-4157-a114-482d1a796009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:07.805821 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49f18b-e97c-4157-a114-482d1a796009 None admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:07.806102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49f18b-e97c-4157-a114-482d1a796009 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:07.806377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49f18b-e97c-4157-a114-482d1a796009 None admin] PATH_INFO: `/v3/projects/6897068dc29445f7878c7c12a0915d48/users/32a61a4fe5c74444af1afdbeaf9be512/roles/81782254e8c2428284b8181e87647f8a` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:07.824389 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49f18b-e97c-4157-a114-482d1a796009 None admin] RBAC: Authorizing `identity:create_grant(project_id=6897068dc29445f7878c7c12a0915d48, user_id=32a61a4fe5c74444af1afdbeaf9be512, role_id=81782254e8c2428284b8181e87647f8a)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:07.826169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49f18b-e97c-4157-a114-482d1a796009 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:07.843771 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 427/853] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:16:07 2022] PUT /identity/v3/projects/6897068dc29445f7878c7c12a0915d48/users/32a61a4fe5c74444af1afdbeaf9be512/roles/81782254e8c2428284b8181e87647f8a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:16:10.241309 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afec6c2-8191-4a27-8e6c-1d5c176bb497 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:10.241976 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afec6c2-8191-4a27-8e6c-1d5c176bb497 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:10.241976 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afec6c2-8191-4a27-8e6c-1d5c176bb497 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:10.244001 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 427/854] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:16:10.250354 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55a49c-c434-4273-9596-9585b2e346c0 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:10.251095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55a49c-c434-4273-9596-9585b2e346c0 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:10.251095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55a49c-c434-4273-9596-9585b2e346c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:10.272986 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-4d55a49c-c434-4273-9596-9585b2e346c0 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:16:10.274787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-4d55a49c-c434-4273-9596-9585b2e346c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:16:10.352348 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 428/855] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:16:10 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:16:10.381228 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afec6c2-8191-4a27-8e6c-1d5c176bb497 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:10.409604 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:10.504534 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afec6c2-8191-4a27-8e6c-1d5c176bb497 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:10.539450 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e75aa2-4d59-4501-be5a-11e608be7c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:10.540068 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e75aa2-4d59-4501-be5a-11e608be7c4b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:10.540341 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e75aa2-4d59-4501-be5a-11e608be7c4b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:10.540605 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e75aa2-4d59-4501-be5a-11e608be7c4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:10.551779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e75aa2-4d59-4501-be5a-11e608be7c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-83e75aa2-4d59-4501-be5a-11e608be7c4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:16:10.557656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:10.558835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:10.559825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:10.559825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:10.559825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:10.559825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:10.559825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:16:10.559825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:16:10.559825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:16:10.559825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:16:10.559825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:16:10.559825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:16:10.559825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:16:10.559825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:16:10.559825 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 428/856] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Jul 26 10:16:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:16:10.565521 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55a49c-c434-4273-9596-9585b2e346c0 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:10.620308 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:10.689975 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55a49c-c434-4273-9596-9585b2e346c0 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:10.727905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e82243-d2ac-4996-8eb5-c2fed9953066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:10.728549 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e82243-d2ac-4996-8eb5-c2fed9953066 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:10.728818 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e82243-d2ac-4996-8eb5-c2fed9953066 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:10.729088 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e82243-d2ac-4996-8eb5-c2fed9953066 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:10.729825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e82243-d2ac-4996-8eb5-c2fed9953066 None admin] RBAC: Adding query filter params (name=service) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:10.730114 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e82243-d2ac-4996-8eb5-c2fed9953066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:10.731563 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e82243-d2ac-4996-8eb5-c2fed9953066 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:10.740108 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 429/857] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Jul 26 10:16:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:10.746125 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e75aa2-4d59-4501-be5a-11e608be7c4b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:10.854575 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:10.874075 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e75aa2-4d59-4501-be5a-11e608be7c4b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:10.918760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a2cd6-7f6c-449a-934c-f510818fb3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:10.919578 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a2cd6-7f6c-449a-934c-f510818fb3f8 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:10.919841 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a2cd6-7f6c-449a-934c-f510818fb3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:10.920140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a2cd6-7f6c-449a-934c-f510818fb3f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:10.932194 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a2cd6-7f6c-449a-934c-f510818fb3f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:10.933788 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a2cd6-7f6c-449a-934c-f510818fb3f8 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:10.950454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-d80a2cd6-7f6c-449a-934c-f510818fb3f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:10.950454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:10.950454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:10.950454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:10.950454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:10.950454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:10.950454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:10.950454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:10.950454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:10.950454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:10.950454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:10.950454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:10.950454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:16:10.950454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:16:10.950454 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:10.951721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:10.953010 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:16:10.953010 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:16:10.953010 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:10.953010 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:16:10.953010 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 429/858] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:10.957893 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e82243-d2ac-4996-8eb5-c2fed9953066 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:11.072089 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e82243-d2ac-4996-8eb5-c2fed9953066 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:11.075177 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:11.114611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2741a-1653-4963-a591-1ce33fa2f38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:11.115162 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2741a-1653-4963-a591-1ce33fa2f38d None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:11.115465 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2741a-1653-4963-a591-1ce33fa2f38d None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:11.115735 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2741a-1653-4963-a591-1ce33fa2f38d None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:11.116432 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2741a-1653-4963-a591-1ce33fa2f38d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:11.116737 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2741a-1653-4963-a591-1ce33fa2f38d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:11.118119 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2741a-1653-4963-a591-1ce33fa2f38d None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:11.131346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 430/859] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:11.137319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a2cd6-7f6c-449a-934c-f510818fb3f8 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:11.258266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a2cd6-7f6c-449a-934c-f510818fb3f8 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:11.303589 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322b362-8a20-4079-ad34-f85701152981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:11.304294 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322b362-8a20-4079-ad34-f85701152981 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:11.304610 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322b362-8a20-4079-ad34-f85701152981 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:11.304945 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322b362-8a20-4079-ad34-f85701152981 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:11.308876 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:11.317819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322b362-8a20-4079-ad34-f85701152981 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:11.319802 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322b362-8a20-4079-ad34-f85701152981 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-5322b362-8a20-4079-ad34-f85701152981 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:16:11.333894 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:11.335201 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:11.336154 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:11.336154 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:11.336154 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:16:11.336154 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:16:11.336154 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:16:11.336154 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:16:11.336154 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:16:11.336154 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:16:11.336154 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:11.336154 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:16:11.336154 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 430/860] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:16:11.341692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2741a-1653-4963-a591-1ce33fa2f38d None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:11.464202 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2741a-1653-4963-a591-1ce33fa2f38d None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:11.503226 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b91bee-0421-40e8-becc-65f414dbbb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:11.503993 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b91bee-0421-40e8-becc-65f414dbbb48 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:11.504257 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b91bee-0421-40e8-becc-65f414dbbb48 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:11.504559 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b91bee-0421-40e8-becc-65f414dbbb48 None admin] PATH_INFO: `/v3/users` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:11.505415 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b91bee-0421-40e8-becc-65f414dbbb48 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:11.505752 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b91bee-0421-40e8-becc-65f414dbbb48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:11.507332 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b91bee-0421-40e8-becc-65f414dbbb48 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:11.528080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 431/861] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Jul 26 10:16:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:16:11.534629 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322b362-8a20-4079-ad34-f85701152981 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:11.663290 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322b362-8a20-4079-ad34-f85701152981 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:11.705863 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c7bf3-da56-4af2-8e27-f00f30389561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:11.706518 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c7bf3-da56-4af2-8e27-f00f30389561 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:11.706795 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c7bf3-da56-4af2-8e27-f00f30389561 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:11.707065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c7bf3-da56-4af2-8e27-f00f30389561 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:11.782940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:11.789797 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c7bf3-da56-4af2-8e27-f00f30389561 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:11.791676 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c7bf3-da56-4af2-8e27-f00f30389561 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:11.906292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 431/862] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:16:11 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:16:11.913600 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b91bee-0421-40e8-becc-65f414dbbb48 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:11.940531 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:12.038772 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b91bee-0421-40e8-becc-65f414dbbb48 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:12.082669 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c18a1f-7ddd-45ac-8416-a579dec98515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:12.083329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c18a1f-7ddd-45ac-8416-a579dec98515 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:12.083606 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c18a1f-7ddd-45ac-8416-a579dec98515 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:12.083879 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c18a1f-7ddd-45ac-8416-a579dec98515 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:12.095981 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c18a1f-7ddd-45ac-8416-a579dec98515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:12.097471 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c18a1f-7ddd-45ac-8416-a579dec98515 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:12.114532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-e2c18a1f-7ddd-45ac-8416-a579dec98515 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:12.114532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:12.114532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:12.114532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:12.114532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:12.114532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:12.114532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:12.114532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:12.114532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:12.114532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:12.114532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:12.114532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:12.114532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:16:12.114532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:16:12.114532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:12.115702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:12.116925 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:16:12.116925 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:16:12.116925 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:12.116925 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:12.116925 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 432/863] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:16:12.122660 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c7bf3-da56-4af2-8e27-f00f30389561 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:12.228930 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:12.236579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c7bf3-da56-4af2-8e27-f00f30389561 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:12.277044 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff0f9c-f337-4c23-9ac3-3e7e24c69c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:12.277740 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff0f9c-f337-4c23-9ac3-3e7e24c69c22 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:12.278091 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff0f9c-f337-4c23-9ac3-3e7e24c69c22 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:12.278370 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff0f9c-f337-4c23-9ac3-3e7e24c69c22 None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:12.279260 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff0f9c-f337-4c23-9ac3-3e7e24c69c22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:12.279662 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff0f9c-f337-4c23-9ac3-3e7e24c69c22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:12.281754 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff0f9c-f337-4c23-9ac3-3e7e24c69c22 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:12.295379 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 432/864] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:12.301679 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c18a1f-7ddd-45ac-8416-a579dec98515 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:12.401217 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:12.430034 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c18a1f-7ddd-45ac-8416-a579dec98515 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:12.474412 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d3805-e8dd-4636-8663-c9dfdca3fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:12.475545 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d3805-e8dd-4636-8663-c9dfdca3fee4 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:12.476194 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d3805-e8dd-4636-8663-c9dfdca3fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:12.476667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d3805-e8dd-4636-8663-c9dfdca3fee4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:12.485241 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d3805-e8dd-4636-8663-c9dfdca3fee4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:12.486835 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d3805-e8dd-4636-8663-c9dfdca3fee4 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:12.500630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-013d3805-e8dd-4636-8663-c9dfdca3fee4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:12.500630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:12.500630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:12.500630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:12.500630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:12.500630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:12.500630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:12.500630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:12.500630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:12.500630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:12.500630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:12.500630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:12.500630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:16:12.500630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:16:12.500630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:12.501805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:12.508700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:16:12.508700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:16:12.508700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:16:12.508700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:16:12.508700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:16:12.508700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:16:12.508700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:12.508700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:12.508700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 433/865] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:16:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:16:12.509940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff0f9c-f337-4c23-9ac3-3e7e24c69c22 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:12.669802 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff0f9c-f337-4c23-9ac3-3e7e24c69c22 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:12.710888 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a7055-993c-4d64-aa1e-1271c1632594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:12.711596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a7055-993c-4d64-aa1e-1271c1632594 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:12.712027 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a7055-993c-4d64-aa1e-1271c1632594 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:12.712473 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a7055-993c-4d64-aa1e-1271c1632594 None admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:12.713780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a7055-993c-4d64-aa1e-1271c1632594 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:12.714219 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a7055-993c-4d64-aa1e-1271c1632594 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:12.716154 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a7055-993c-4d64-aa1e-1271c1632594 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:12.729255 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 433/866] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:16:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:12.738604 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d3805-e8dd-4636-8663-c9dfdca3fee4 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:12.851294 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d3805-e8dd-4636-8663-c9dfdca3fee4 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:12.894079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d1b78-825c-4b22-9c02-4df04cbce388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:12.894739 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d1b78-825c-4b22-9c02-4df04cbce388 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:12.895014 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d1b78-825c-4b22-9c02-4df04cbce388 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:12.895282 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d1b78-825c-4b22-9c02-4df04cbce388 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:12.896083 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d1b78-825c-4b22-9c02-4df04cbce388 None admin] RBAC: Adding query filter params (role.id=81782254e8c2428284b8181e87647f8a, scope.project.id=6897068dc29445f7878c7c12a0915d48, user.id=32a61a4fe5c74444af1afdbeaf9be512) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:12.896379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d1b78-825c-4b22-9c02-4df04cbce388 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:12.897905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d1b78-825c-4b22-9c02-4df04cbce388 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:12.899894 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:12.911205 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 434/867] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:16:12 2022] GET /identity/v3/role_assignments?user.id=32a61a4fe5c74444af1afdbeaf9be512&scope.project.id=6897068dc29445f7878c7c12a0915d48&role.id=81782254e8c2428284b8181e87647f8a => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:15.533692 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d49e51-cd54-4631-b93b-56ef9e4bc95c None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:15.534298 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d49e51-cd54-4631-b93b-56ef9e4bc95c None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:15.534298 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d49e51-cd54-4631-b93b-56ef9e4bc95c None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:15.538479 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 434/868] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:16:15.541871 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5e515-41b8-407d-bcf8-bac6f72d6bad None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:15.542308 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5e515-41b8-407d-bcf8-bac6f72d6bad None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:15.542448 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5e515-41b8-407d-bcf8-bac6f72d6bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:15.560716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-7ac5e515-41b8-407d-bcf8-bac6f72d6bad None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:16:15.561915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-7ac5e515-41b8-407d-bcf8-bac6f72d6bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:16:15.645709 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 435/869] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:16:15 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:16:15.675843 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d49e51-cd54-4631-b93b-56ef9e4bc95c None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:15.706377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:15.812247 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d49e51-cd54-4631-b93b-56ef9e4bc95c None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:15.859882 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa0b6e-c845-4e76-b1d3-6f14c9a23f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:15.860541 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa0b6e-c845-4e76-b1d3-6f14c9a23f73 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:15.860832 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa0b6e-c845-4e76-b1d3-6f14c9a23f73 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:15.861097 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa0b6e-c845-4e76-b1d3-6f14c9a23f73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:15.873902 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa0b6e-c845-4e76-b1d3-6f14c9a23f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-7aaa0b6e-c845-4e76-b1d3-6f14c9a23f73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:16:15.879411 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:15.880506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:15.881344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:15.881344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:15.881344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:15.881344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:15.881344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:16:15.881344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:16:15.881344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:16:15.881344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:16:15.881344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:16:15.881344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:16:15.881344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:16:15.881344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:16:15.881344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 435/870] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:16:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:15.887131 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5e515-41b8-407d-bcf8-bac6f72d6bad None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:15.998936 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5e515-41b8-407d-bcf8-bac6f72d6bad None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:16.030627 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:16.040138 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8ef85-389d-426f-99ae-86b069b3dbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:16.040774 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8ef85-389d-426f-99ae-86b069b3dbd9 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:16.041090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8ef85-389d-426f-99ae-86b069b3dbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:16.041324 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8ef85-389d-426f-99ae-86b069b3dbd9 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:16.042051 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8ef85-389d-426f-99ae-86b069b3dbd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:16.042404 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8ef85-389d-426f-99ae-86b069b3dbd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:16.043931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8ef85-389d-426f-99ae-86b069b3dbd9 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:16.063393 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 436/871] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:16:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:16.069557 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa0b6e-c845-4e76-b1d3-6f14c9a23f73 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:16.172395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:16.200534 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa0b6e-c845-4e76-b1d3-6f14c9a23f73 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:16.245198 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12169e6-a0e0-4517-b274-ee5237370da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:16.246147 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12169e6-a0e0-4517-b274-ee5237370da8 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:16.246650 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12169e6-a0e0-4517-b274-ee5237370da8 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:16.247173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12169e6-a0e0-4517-b274-ee5237370da8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:16.260700 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12169e6-a0e0-4517-b274-ee5237370da8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:16.262508 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12169e6-a0e0-4517-b274-ee5237370da8 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:16.282760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-a12169e6-a0e0-4517-b274-ee5237370da8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:16.282760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:16.282760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:16.282760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:16.282760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:16.282760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:16.282760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:16.282760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:16.282760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:16.282760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:16.282760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:16.282760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:16.282760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:16:16.282760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:16:16.282760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:16.283917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:16.284822 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:16:16.284822 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:16:16.284822 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:16.284822 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:16:16.284822 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 436/872] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:16.290285 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8ef85-389d-426f-99ae-86b069b3dbd9 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:16.402160 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8ef85-389d-426f-99ae-86b069b3dbd9 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:16.441857 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44932b99-182c-422f-8821-db67c6fa35d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:16.442495 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44932b99-182c-422f-8821-db67c6fa35d6 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:16.442773 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44932b99-182c-422f-8821-db67c6fa35d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:16.443046 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44932b99-182c-422f-8821-db67c6fa35d6 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:16.443744 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44932b99-182c-422f-8821-db67c6fa35d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:16.444049 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44932b99-182c-422f-8821-db67c6fa35d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:16.445540 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44932b99-182c-422f-8821-db67c6fa35d6 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:16.458912 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 437/873] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:16.464971 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12169e6-a0e0-4517-b274-ee5237370da8 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:16.582842 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12169e6-a0e0-4517-b274-ee5237370da8 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:16.616082 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:16.626014 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074c513-25a1-4aa6-a126-d9f91137c93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:16.626727 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074c513-25a1-4aa6-a126-d9f91137c93a None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:16.627010 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074c513-25a1-4aa6-a126-d9f91137c93a None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:16.627290 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074c513-25a1-4aa6-a126-d9f91137c93a None admin] PATH_INFO: `/v3/users/placement` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:16.637930 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074c513-25a1-4aa6-a126-d9f91137c93a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:16.639627 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074c513-25a1-4aa6-a126-d9f91137c93a None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-e074c513-25a1-4aa6-a126-d9f91137c93a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:16:16.655209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:16.656682 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:16.658069 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:16.658069 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:16.658069 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:16:16.658069 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:16:16.658069 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:16:16.658069 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:16:16.658069 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:16:16.658069 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:16:16.658069 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:16.658069 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:16:16.658069 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 437/874] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:16.663254 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44932b99-182c-422f-8821-db67c6fa35d6 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:16.728361 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:16.789170 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44932b99-182c-422f-8821-db67c6fa35d6 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:16.829986 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e248ca1-1cae-435b-a3f9-7caabde8bdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:16.831188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e248ca1-1cae-435b-a3f9-7caabde8bdb3 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:16.831188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e248ca1-1cae-435b-a3f9-7caabde8bdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:16.831188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e248ca1-1cae-435b-a3f9-7caabde8bdb3 None admin] PATH_INFO: `/v3/users` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:16.831953 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e248ca1-1cae-435b-a3f9-7caabde8bdb3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:16.832266 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e248ca1-1cae-435b-a3f9-7caabde8bdb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:16.833709 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e248ca1-1cae-435b-a3f9-7caabde8bdb3 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:16.858407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 438/875] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Jul 26 10:16:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:16:16.864283 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074c513-25a1-4aa6-a126-d9f91137c93a None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:16.977041 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074c513-25a1-4aa6-a126-d9f91137c93a None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:17.018979 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef055e5-0b9b-4c89-97b9-98c7f94f625d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:17.019238 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef055e5-0b9b-4c89-97b9-98c7f94f625d None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:17.019525 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef055e5-0b9b-4c89-97b9-98c7f94f625d None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:17.019809 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef055e5-0b9b-4c89-97b9-98c7f94f625d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:17.086908 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:17.104646 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef055e5-0b9b-4c89-97b9-98c7f94f625d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:17.106176 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef055e5-0b9b-4c89-97b9-98c7f94f625d None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:17.220323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 438/876] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:16:16 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:16:17.226693 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e248ca1-1cae-435b-a3f9-7caabde8bdb3 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:17.359050 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e248ca1-1cae-435b-a3f9-7caabde8bdb3 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:17.372771 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:17.406980 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691353e6-6c80-48ae-8743-734b520fc598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:17.407686 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691353e6-6c80-48ae-8743-734b520fc598 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:17.407942 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691353e6-6c80-48ae-8743-734b520fc598 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:17.408215 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691353e6-6c80-48ae-8743-734b520fc598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:17.421192 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691353e6-6c80-48ae-8743-734b520fc598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:17.422740 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691353e6-6c80-48ae-8743-734b520fc598 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:17.441336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-691353e6-6c80-48ae-8743-734b520fc598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:17.441336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:17.441336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:17.441336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:17.441336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:17.441336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:17.441336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:17.441336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:17.441336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:17.441336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:17.441336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:17.441336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:17.441336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:16:17.441336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:16:17.441336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:17.442485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:17.449126 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:16:17.449126 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:16:17.449126 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:17.449126 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:17.449126 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 439/877] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:17.449494 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef055e5-0b9b-4c89-97b9-98c7f94f625d None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:17.556423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:17.570122 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef055e5-0b9b-4c89-97b9-98c7f94f625d None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:17.609795 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7ee5a-67c8-4c2b-b04b-fe75e2e4da7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:17.610541 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7ee5a-67c8-4c2b-b04b-fe75e2e4da7d None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:17.610886 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7ee5a-67c8-4c2b-b04b-fe75e2e4da7d None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:17.611223 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7ee5a-67c8-4c2b-b04b-fe75e2e4da7d None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:17.612174 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7ee5a-67c8-4c2b-b04b-fe75e2e4da7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:17.612482 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7ee5a-67c8-4c2b-b04b-fe75e2e4da7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:17.613926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7ee5a-67c8-4c2b-b04b-fe75e2e4da7d None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:17.635097 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 439/878] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:17.642235 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691353e6-6c80-48ae-8743-734b520fc598 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:17.778020 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691353e6-6c80-48ae-8743-734b520fc598 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:17.820762 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582581d6-9308-4dc7-bf2c-25340908c877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:17.821453 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582581d6-9308-4dc7-bf2c-25340908c877 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:17.821752 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582581d6-9308-4dc7-bf2c-25340908c877 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:17.822028 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582581d6-9308-4dc7-bf2c-25340908c877 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:17.841244 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582581d6-9308-4dc7-bf2c-25340908c877 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:17.843569 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582581d6-9308-4dc7-bf2c-25340908c877 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:17.859647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-582581d6-9308-4dc7-bf2c-25340908c877 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:17.859647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:17.859647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:17.859647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:17.859647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:17.859647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:17.859647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:17.859647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:17.859647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:17.859647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:17.859647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:17.859647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:17.859647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:16:17.859647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:16:17.859647 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:17.860867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:17.861779 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:16:17.861779 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:16:17.861779 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:16:17.861779 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:16:17.861779 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:16:17.861779 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:16:17.861779 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:17.861779 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:17.861779 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 440/879] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:16:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:17.867790 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7ee5a-67c8-4c2b-b04b-fe75e2e4da7d None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:17.991091 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7ee5a-67c8-4c2b-b04b-fe75e2e4da7d None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:18.028846 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1772a48-7b4b-4bcd-8373-6deacb5366fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:18.029475 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1772a48-7b4b-4bcd-8373-6deacb5366fb None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:18.029756 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1772a48-7b4b-4bcd-8373-6deacb5366fb None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:18.030026 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1772a48-7b4b-4bcd-8373-6deacb5366fb None admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:18.030824 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1772a48-7b4b-4bcd-8373-6deacb5366fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:18.031451 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1772a48-7b4b-4bcd-8373-6deacb5366fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:18.032912 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1772a48-7b4b-4bcd-8373-6deacb5366fb None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:18.049719 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 440/880] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:16:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:18.056322 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582581d6-9308-4dc7-bf2c-25340908c877 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:18.080846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:18.168281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582581d6-9308-4dc7-bf2c-25340908c877 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:18.212832 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899c867-e819-4788-bbda-822dc1b0380f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:18.213451 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899c867-e819-4788-bbda-822dc1b0380f None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:18.213731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899c867-e819-4788-bbda-822dc1b0380f None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:18.213999 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899c867-e819-4788-bbda-822dc1b0380f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:18.214829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899c867-e819-4788-bbda-822dc1b0380f None admin] RBAC: Adding query filter params (role.id=7d88b748366a42929784db05d53fe473, scope.project.id=6897068dc29445f7878c7c12a0915d48, user.id=32a61a4fe5c74444af1afdbeaf9be512) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:18.215142 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899c867-e819-4788-bbda-822dc1b0380f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:18.217289 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899c867-e819-4788-bbda-822dc1b0380f None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:18.223204 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 441/881] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:16:18 2022] GET /identity/v3/role_assignments?user.id=32a61a4fe5c74444af1afdbeaf9be512&scope.project.id=6897068dc29445f7878c7c12a0915d48&role.id=7d88b748366a42929784db05d53fe473 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:20.474370 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fb9c9-3427-4ece-958e-3f386b196610 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:20.474975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fb9c9-3427-4ece-958e-3f386b196610 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:20.474975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fb9c9-3427-4ece-958e-3f386b196610 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:20.477043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 441/882] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:16:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:16:20.483656 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ea634-c3fb-44ae-920d-68a2e63faec6 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:20.484102 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ea634-c3fb-44ae-920d-68a2e63faec6 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:20.484220 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ea634-c3fb-44ae-920d-68a2e63faec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:20.506187 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-172ea634-c3fb-44ae-920d-68a2e63faec6 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:16:20.507421 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-172ea634-c3fb-44ae-920d-68a2e63faec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:16:20.580245 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 442/883] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:16:20 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:16:20.604790 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fb9c9-3427-4ece-958e-3f386b196610 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:20.616453 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:20.726215 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fb9c9-3427-4ece-958e-3f386b196610 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:20.766053 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5d61a-1a4c-48f2-b9e4-1c8ba2c7874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:20.766755 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5d61a-1a4c-48f2-b9e4-1c8ba2c7874b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:20.767030 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5d61a-1a4c-48f2-b9e4-1c8ba2c7874b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:20.767298 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5d61a-1a4c-48f2-b9e4-1c8ba2c7874b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:20.779589 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5d61a-1a4c-48f2-b9e4-1c8ba2c7874b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-c8e5d61a-1a4c-48f2-b9e4-1c8ba2c7874b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:16:20.785022 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:20.786140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:20.787141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:20.787141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:20.787141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:20.787141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:20.787141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:16:20.787141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:16:20.787141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:16:20.787141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:16:20.787141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:16:20.787141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:16:20.787141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:16:20.787141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:16:20.787141 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 442/884] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:16:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:20.792811 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ea634-c3fb-44ae-920d-68a2e63faec6 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:20.809995 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:20.910058 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ea634-c3fb-44ae-920d-68a2e63faec6 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:20.946777 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de980f27-f485-486a-a544-544d2311faa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:20.947427 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de980f27-f485-486a-a544-544d2311faa8 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:20.947738 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de980f27-f485-486a-a544-544d2311faa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:20.948026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de980f27-f485-486a-a544-544d2311faa8 None admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:20.948749 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de980f27-f485-486a-a544-544d2311faa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:20.949056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de980f27-f485-486a-a544-544d2311faa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:20.950463 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de980f27-f485-486a-a544-544d2311faa8 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:20.959766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 443/885] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:16:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:20.965771 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5d61a-1a4c-48f2-b9e4-1c8ba2c7874b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:21.036495 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:21.071764 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5d61a-1a4c-48f2-b9e4-1c8ba2c7874b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:21.108355 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414d259-e7ad-4a47-9e5d-d7f2f64d83f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:21.109005 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414d259-e7ad-4a47-9e5d-d7f2f64d83f9 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:21.109278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414d259-e7ad-4a47-9e5d-d7f2f64d83f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:21.109546 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414d259-e7ad-4a47-9e5d-d7f2f64d83f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:21.120284 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414d259-e7ad-4a47-9e5d-d7f2f64d83f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:21.121739 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414d259-e7ad-4a47-9e5d-d7f2f64d83f9 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:21.136779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-8414d259-e7ad-4a47-9e5d-d7f2f64d83f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:21.136779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:21.136779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:21.136779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:21.136779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:21.136779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:21.136779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:21.136779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:21.136779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:21.136779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:21.136779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:21.136779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:21.136779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:16:21.136779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:16:21.136779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:21.137857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:21.138872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:16:21.138872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:16:21.138872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:21.138872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:16:21.138872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 443/886] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:21.144389 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de980f27-f485-486a-a544-544d2311faa8 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:21.224526 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:21.248325 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de980f27-f485-486a-a544-544d2311faa8 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:21.282144 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ede9eb-6166-4970-982e-425b98747b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:21.282716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ede9eb-6166-4970-982e-425b98747b36 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:21.282996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ede9eb-6166-4970-982e-425b98747b36 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:21.283269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ede9eb-6166-4970-982e-425b98747b36 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:21.283964 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ede9eb-6166-4970-982e-425b98747b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:21.284269 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ede9eb-6166-4970-982e-425b98747b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:21.285648 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ede9eb-6166-4970-982e-425b98747b36 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:21.298386 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 444/887] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:21.304741 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414d259-e7ad-4a47-9e5d-d7f2f64d83f9 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:21.410890 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414d259-e7ad-4a47-9e5d-d7f2f64d83f9 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:21.431924 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:21.448395 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2630c59-ea69-4246-846b-034a22bf7da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:21.449048 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2630c59-ea69-4246-846b-034a22bf7da7 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:21.449327 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2630c59-ea69-4246-846b-034a22bf7da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:21.449596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2630c59-ea69-4246-846b-034a22bf7da7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:21.459656 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2630c59-ea69-4246-846b-034a22bf7da7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:21.461834 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2630c59-ea69-4246-846b-034a22bf7da7 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-e2630c59-ea69-4246-846b-034a22bf7da7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:16:21.474004 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:21.475513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:21.476507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:21.476507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:21.476507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:16:21.476507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:16:21.476507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:16:21.476507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:16:21.476507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:16:21.476507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:16:21.476507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:21.476507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:16:21.476507 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 444/888] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:21.481377 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ede9eb-6166-4970-982e-425b98747b36 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:21.601236 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ede9eb-6166-4970-982e-425b98747b36 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:21.643221 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4138a90-f234-416d-9bb4-7ff33643d27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:21.643991 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4138a90-f234-416d-9bb4-7ff33643d27b None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:21.644311 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4138a90-f234-416d-9bb4-7ff33643d27b None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:21.644653 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4138a90-f234-416d-9bb4-7ff33643d27b None admin] PATH_INFO: `/v3/users` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:21.645504 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4138a90-f234-416d-9bb4-7ff33643d27b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:21.646095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4138a90-f234-416d-9bb4-7ff33643d27b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:21.647864 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4138a90-f234-416d-9bb4-7ff33643d27b None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:21.651599 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:21.670928 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 445/889] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Jul 26 10:16:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:21.678442 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2630c59-ea69-4246-846b-034a22bf7da7 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:21.781722 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2630c59-ea69-4246-846b-034a22bf7da7 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:21.816709 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0e7b6-9e52-4199-9560-cd8f770580cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:21.817350 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0e7b6-9e52-4199-9560-cd8f770580cd None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:21.817623 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0e7b6-9e52-4199-9560-cd8f770580cd None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:21.817893 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0e7b6-9e52-4199-9560-cd8f770580cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:21.828954 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0e7b6-9e52-4199-9560-cd8f770580cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:21.830425 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0e7b6-9e52-4199-9560-cd8f770580cd None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:21.845396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-99a0e7b6-9e52-4199-9560-cd8f770580cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:21.845396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:21.845396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:21.845396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:21.845396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:21.845396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:21.845396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:21.845396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:21.845396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:21.845396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:21.845396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:21.845396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:21.845396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:16:21.845396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:16:21.845396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:21.846506 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:21.847446 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:16:21.847446 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:16:21.847446 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:21.847446 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:16:21.847446 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 445/890] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:21.852937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4138a90-f234-416d-9bb4-7ff33643d27b None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:21.955176 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4138a90-f234-416d-9bb4-7ff33643d27b None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:21.990778 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908acd0-84de-4bd0-ac28-dca059fa1809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:21.991444 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908acd0-84de-4bd0-ac28-dca059fa1809 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:21.991722 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908acd0-84de-4bd0-ac28-dca059fa1809 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:21.992003 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908acd0-84de-4bd0-ac28-dca059fa1809 None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:21.992759 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908acd0-84de-4bd0-ac28-dca059fa1809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:21.993066 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908acd0-84de-4bd0-ac28-dca059fa1809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:21.994481 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908acd0-84de-4bd0-ac28-dca059fa1809 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:22.006135 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 446/891] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:22.012101 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0e7b6-9e52-4199-9560-cd8f770580cd None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:22.047135 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:22.124543 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0e7b6-9e52-4199-9560-cd8f770580cd None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:22.161751 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028ee49-31a2-48a3-8e3a-bce34ed878b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:22.162406 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028ee49-31a2-48a3-8e3a-bce34ed878b7 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:22.162719 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028ee49-31a2-48a3-8e3a-bce34ed878b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:22.162984 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028ee49-31a2-48a3-8e3a-bce34ed878b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:22.170526 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028ee49-31a2-48a3-8e3a-bce34ed878b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:22.171995 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028ee49-31a2-48a3-8e3a-bce34ed878b7 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:22.184332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-d028ee49-31a2-48a3-8e3a-bce34ed878b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:22.184332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:22.184332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:22.184332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:22.184332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:22.184332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:22.184332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:22.184332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:22.184332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:22.184332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:22.184332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:22.184332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:22.184332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:16:22.184332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:16:22.184332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:22.185468 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:22.186367 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:16:22.186367 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:16:22.186367 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:16:22.186367 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:16:22.186367 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:16:22.186367 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:16:22.186367 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:22.186367 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:16:22.186367 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 446/892] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:16:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:16:22.192401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908acd0-84de-4bd0-ac28-dca059fa1809 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:22.252193 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:22.302742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908acd0-84de-4bd0-ac28-dca059fa1809 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:22.342453 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ea57-5e25-43d9-836e-ee94eb84eb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:22.343099 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ea57-5e25-43d9-836e-ee94eb84eb4d None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:22.343381 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ea57-5e25-43d9-836e-ee94eb84eb4d None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:22.343654 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ea57-5e25-43d9-836e-ee94eb84eb4d None admin] PATH_INFO: `/v3/projects` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:22.344424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88ea57-5e25-43d9-836e-ee94eb84eb4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:22.344740 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88ea57-5e25-43d9-836e-ee94eb84eb4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:22.346203 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88ea57-5e25-43d9-836e-ee94eb84eb4d None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:22.359932 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 447/893] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:22.366463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028ee49-31a2-48a3-8e3a-bce34ed878b7 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:22.466814 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:22.476552 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028ee49-31a2-48a3-8e3a-bce34ed878b7 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:22.512720 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334d4cc-b78f-4aec-8cb8-cb121306b1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:22.513393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d4cc-b78f-4aec-8cb8-cb121306b1e0 None admin] REQUEST_METHOD: `PUT` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:22.513665 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d4cc-b78f-4aec-8cb8-cb121306b1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:22.513930 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d4cc-b78f-4aec-8cb8-cb121306b1e0 None admin] PATH_INFO: `/v3/projects/6897068dc29445f7878c7c12a0915d48/users/32a61a4fe5c74444af1afdbeaf9be512/roles/7d88b748366a42929784db05d53fe473` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:22.516081 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334d4cc-b78f-4aec-8cb8-cb121306b1e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6897068dc29445f7878c7c12a0915d48, user_id=32a61a4fe5c74444af1afdbeaf9be512, role_id=7d88b748366a42929784db05d53fe473)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:22.517614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334d4cc-b78f-4aec-8cb8-cb121306b1e0 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:22.532438 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 447/894] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Jul 26 10:16:22 2022] PUT /identity/v3/projects/6897068dc29445f7878c7c12a0915d48/users/32a61a4fe5c74444af1afdbeaf9be512/roles/7d88b748366a42929784db05d53fe473 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:16:24.732856 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b0131-dfa1-4247-8e45-b36efc42a4d1 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:24.733753 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b0131-dfa1-4247-8e45-b36efc42a4d1 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:24.733753 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b0131-dfa1-4247-8e45-b36efc42a4d1 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:24.735952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 448/895] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:16:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:16:24.744853 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210840e-75fa-46bc-b9b9-33d1201c7ba2 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:24.745294 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210840e-75fa-46bc-b9b9-33d1201c7ba2 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:24.745425 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210840e-75fa-46bc-b9b9-33d1201c7ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:24.770277 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-3210840e-75fa-46bc-b9b9-33d1201c7ba2 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:16:24.771534 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-3210840e-75fa-46bc-b9b9-33d1201c7ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:16:24.845342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 448/896] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:16:24 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:16:24.870584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b0131-dfa1-4247-8e45-b36efc42a4d1 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:24.993945 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b0131-dfa1-4247-8e45-b36efc42a4d1 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:25.009751 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:25.036183 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248c051-e7c9-4fb7-b3af-7e5f8da768f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:25.036831 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248c051-e7c9-4fb7-b3af-7e5f8da768f2 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:25.037106 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248c051-e7c9-4fb7-b3af-7e5f8da768f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:25.037375 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248c051-e7c9-4fb7-b3af-7e5f8da768f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:25.047969 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248c051-e7c9-4fb7-b3af-7e5f8da768f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-6248c051-e7c9-4fb7-b3af-7e5f8da768f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:16:25.052915 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:25.053998 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:25.055026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:25.055026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:25.055026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:25.055026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:25.055026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:16:25.055026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:16:25.055026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:16:25.055026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:16:25.055026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:16:25.055026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:16:25.055026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:16:25.055026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:25.055026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 449/897] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Jul 26 10:16:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:25.060529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210840e-75fa-46bc-b9b9-33d1201c7ba2 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:25.143285 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:25.163942 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210840e-75fa-46bc-b9b9-33d1201c7ba2 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:25.204281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304f537-293a-44a6-b3e7-b877226e40e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:25.205215 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304f537-293a-44a6-b3e7-b877226e40e5 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:25.205787 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304f537-293a-44a6-b3e7-b877226e40e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:25.206079 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304f537-293a-44a6-b3e7-b877226e40e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:25.207259 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304f537-293a-44a6-b3e7-b877226e40e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:25.207726 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304f537-293a-44a6-b3e7-b877226e40e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:25.209899 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304f537-293a-44a6-b3e7-b877226e40e5 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:25.219631 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 449/898] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Jul 26 10:16:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:25.225658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248c051-e7c9-4fb7-b3af-7e5f8da768f2 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:25.332463 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248c051-e7c9-4fb7-b3af-7e5f8da768f2 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:25.367698 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c74db-5c72-45f5-b038-67cda1a496b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:25.368332 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c74db-5c72-45f5-b038-67cda1a496b7 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:25.368611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c74db-5c72-45f5-b038-67cda1a496b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:25.368886 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c74db-5c72-45f5-b038-67cda1a496b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:25.379229 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c74db-5c72-45f5-b038-67cda1a496b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:25.380735 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c74db-5c72-45f5-b038-67cda1a496b7 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:25.395792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-7a0c74db-5c72-45f5-b038-67cda1a496b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:25.395792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:25.395792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:25.395792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:25.395792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:25.395792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:25.395792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:25.395792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:25.395792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:25.395792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:25.395792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:25.395792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:25.395792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:16:25.395792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:16:25.395792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:25.396938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:25.397977 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:16:25.397977 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:16:25.397977 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:25.397977 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:25.398804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 450/899] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:25.402975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304f537-293a-44a6-b3e7-b877226e40e5 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:25.523396 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304f537-293a-44a6-b3e7-b877226e40e5 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:25.562026 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24d812-742e-4090-ba99-56ce24e56964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:25.562680 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24d812-742e-4090-ba99-56ce24e56964 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:25.562961 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24d812-742e-4090-ba99-56ce24e56964 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:25.563234 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24d812-742e-4090-ba99-56ce24e56964 None admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:25.563935 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24d812-742e-4090-ba99-56ce24e56964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:25.564218 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24d812-742e-4090-ba99-56ce24e56964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:25.565641 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24d812-742e-4090-ba99-56ce24e56964 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:25.577949 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 450/900] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:25.584164 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c74db-5c72-45f5-b038-67cda1a496b7 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:25.621128 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:25.718546 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c74db-5c72-45f5-b038-67cda1a496b7 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:25.757097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763d374-156a-4f93-af2d-d64f40cb74f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:25.757785 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763d374-156a-4f93-af2d-d64f40cb74f9 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:25.758014 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763d374-156a-4f93-af2d-d64f40cb74f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:25.758275 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763d374-156a-4f93-af2d-d64f40cb74f9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:25.767097 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763d374-156a-4f93-af2d-d64f40cb74f9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:25.768532 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763d374-156a-4f93-af2d-d64f40cb74f9 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-6763d374-156a-4f93-af2d-d64f40cb74f9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:16:25.780224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:25.781675 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:25.783658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:25.783658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:25.783658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:16:25.783658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:16:25.783658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:16:25.783658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:16:25.783658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:16:25.783658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:16:25.783658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:25.783658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:25.783658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 451/901] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:16:25.789917 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24d812-742e-4090-ba99-56ce24e56964 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:25.793925 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:25.897217 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24d812-742e-4090-ba99-56ce24e56964 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:25.943585 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8bfc5-f134-4eff-bd03-5ce4dfce7c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:25.944206 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8bfc5-f134-4eff-bd03-5ce4dfce7c82 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:25.944479 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8bfc5-f134-4eff-bd03-5ce4dfce7c82 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:25.944741 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8bfc5-f134-4eff-bd03-5ce4dfce7c82 None admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:25.945577 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8bfc5-f134-4eff-bd03-5ce4dfce7c82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:25.945877 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8bfc5-f134-4eff-bd03-5ce4dfce7c82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:25.947338 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8bfc5-f134-4eff-bd03-5ce4dfce7c82 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:25.965246 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 451/902] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Jul 26 10:16:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:25.971972 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763d374-156a-4f93-af2d-d64f40cb74f9 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:26.068080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:26.085201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763d374-156a-4f93-af2d-d64f40cb74f9 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:26.125144 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda30b4-cf62-4f1b-a5ab-5e8b847c5582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:26.125759 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda30b4-cf62-4f1b-a5ab-5e8b847c5582 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:26.126033 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda30b4-cf62-4f1b-a5ab-5e8b847c5582 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:26.126299 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda30b4-cf62-4f1b-a5ab-5e8b847c5582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:26.202036 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda30b4-cf62-4f1b-a5ab-5e8b847c5582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:26.203439 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda30b4-cf62-4f1b-a5ab-5e8b847c5582 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:26.306260 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:26.325513 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 452/903] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Jul 26 10:16:25 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:16:26.332033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8bfc5-f134-4eff-bd03-5ce4dfce7c82 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:26.397536 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:26.443245 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8bfc5-f134-4eff-bd03-5ce4dfce7c82 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:26.480402 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fda79-12cd-400d-9148-64aa79304643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:26.480962 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fda79-12cd-400d-9148-64aa79304643 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:26.481241 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fda79-12cd-400d-9148-64aa79304643 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:26.481606 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fda79-12cd-400d-9148-64aa79304643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:26.492864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fda79-12cd-400d-9148-64aa79304643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:26.494336 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fda79-12cd-400d-9148-64aa79304643 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:26.510202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-4a5fda79-12cd-400d-9148-64aa79304643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:26.510202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:26.510202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:26.510202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:26.510202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:26.510202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:26.510202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:26.510202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:26.510202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:26.510202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:26.510202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:26.510202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:26.510202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:16:26.510202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:16:26.510202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:26.511323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:26.512251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:16:26.512251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:16:26.512251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:26.512251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:16:26.512251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 452/904] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:26.518631 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda30b4-cf62-4f1b-a5ab-5e8b847c5582 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:26.631626 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda30b4-cf62-4f1b-a5ab-5e8b847c5582 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:26.668511 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b90a6-1289-4ebc-b9c9-e95c65a6988b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:26.669121 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b90a6-1289-4ebc-b9c9-e95c65a6988b None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:26.669399 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b90a6-1289-4ebc-b9c9-e95c65a6988b None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:26.669668 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b90a6-1289-4ebc-b9c9-e95c65a6988b None admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:26.670350 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b90a6-1289-4ebc-b9c9-e95c65a6988b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:26.670680 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b90a6-1289-4ebc-b9c9-e95c65a6988b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:26.672064 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b90a6-1289-4ebc-b9c9-e95c65a6988b None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:26.684162 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 453/905] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Jul 26 10:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:26.690721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fda79-12cd-400d-9148-64aa79304643 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:26.805734 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fda79-12cd-400d-9148-64aa79304643 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:26.821433 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:26.844040 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a317-db8b-48ab-9d13-6b90767c5389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:26.844690 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a317-db8b-48ab-9d13-6b90767c5389 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:26.844965 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a317-db8b-48ab-9d13-6b90767c5389 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:26.845235 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a317-db8b-48ab-9d13-6b90767c5389 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:26.852583 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a317-db8b-48ab-9d13-6b90767c5389 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:26.854041 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a317-db8b-48ab-9d13-6b90767c5389 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:26.867725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application [None req-dad1a317-db8b-48ab-9d13-6b90767c5389 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:26.867725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:26.867725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:26.867725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:26.867725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:26.867725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:26.867725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:26.867725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:26.867725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:26.867725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:26.867725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:26.867725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:26.867725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:16:26.867725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:16:26.867725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:26.868827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:26.870167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:16:26.870167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:16:26.870167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:16:26.870167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:16:26.870167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:16:26.870167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:16:26.870167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:26.870167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: ERROR keystone.server.flask.application Jul 26 10:16:26.870167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 453/906] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Jul 26 10:16:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:26.875065 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b90a6-1289-4ebc-b9c9-e95c65a6988b None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:26.925975 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:27.003605 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b90a6-1289-4ebc-b9c9-e95c65a6988b None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:27.040809 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c01f2a-b5a1-4298-a598-f217a6ee53bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:27.041438 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c01f2a-b5a1-4298-a598-f217a6ee53bd None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:27.041711 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c01f2a-b5a1-4298-a598-f217a6ee53bd None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:27.041982 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c01f2a-b5a1-4298-a598-f217a6ee53bd None admin] PATH_INFO: `/v3/projects` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:27.042771 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c01f2a-b5a1-4298-a598-f217a6ee53bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:27.043072 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c01f2a-b5a1-4298-a598-f217a6ee53bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:27.044518 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c01f2a-b5a1-4298-a598-f217a6ee53bd None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:27.056931 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 454/907] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Jul 26 10:16:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:27.063226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a317-db8b-48ab-9d13-6b90767c5389 None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:27.172851 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a317-db8b-48ab-9d13-6b90767c5389 None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:27.208175 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df097968-d040-4498-9a17-875af68d5c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:27.208781 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df097968-d040-4498-9a17-875af68d5c71 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:27.209162 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df097968-d040-4498-9a17-875af68d5c71 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:27.209308 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df097968-d040-4498-9a17-875af68d5c71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:27.210115 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df097968-d040-4498-9a17-875af68d5c71 None admin] RBAC: Adding query filter params (role.id=7d88b748366a42929784db05d53fe473, scope.project.id=6897068dc29445f7878c7c12a0915d48, user.id=32a61a4fe5c74444af1afdbeaf9be512) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:27.210482 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df097968-d040-4498-9a17-875af68d5c71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:27.211943 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df097968-d040-4498-9a17-875af68d5c71 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:27.217909 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 454/908] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Jul 26 10:16:27 2022] GET /identity/v3/role_assignments?user.id=32a61a4fe5c74444af1afdbeaf9be512&scope.project.id=6897068dc29445f7878c7c12a0915d48&role.id=7d88b748366a42929784db05d53fe473 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:29.467649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54a737-f1a1-41c9-8c2d-4c9e9980ade6 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:29.468511 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54a737-f1a1-41c9-8c2d-4c9e9980ade6 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:29.468511 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54a737-f1a1-41c9-8c2d-4c9e9980ade6 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:29.470744 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 455/909] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:16:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:16:29.479679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30837ea1-fbb5-4a46-900d-7828a1c23c0b None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:29.480363 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30837ea1-fbb5-4a46-900d-7828a1c23c0b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:29.480505 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30837ea1-fbb5-4a46-900d-7828a1c23c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:29.504216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-30837ea1-fbb5-4a46-900d-7828a1c23c0b None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:16:29.505422 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-30837ea1-fbb5-4a46-900d-7828a1c23c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:16:29.537495 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:29.580296 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 455/910] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:16:29 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:16:29.604767 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54a737-f1a1-41c9-8c2d-4c9e9980ade6 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:29.742580 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54a737-f1a1-41c9-8c2d-4c9e9980ade6 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:29.750452 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:29.782036 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d507d74-0ada-40b6-a5ed-b7d501d8377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:29.782726 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d507d74-0ada-40b6-a5ed-b7d501d8377d None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:29.783013 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d507d74-0ada-40b6-a5ed-b7d501d8377d None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:29.783280 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d507d74-0ada-40b6-a5ed-b7d501d8377d None admin] PATH_INFO: `/v3/services/placement` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:29.784320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d507d74-0ada-40b6-a5ed-b7d501d8377d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:29.785300 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d507d74-0ada-40b6-a5ed-b7d501d8377d None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-1d507d74-0ada-40b6-a5ed-b7d501d8377d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:29.794578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:29.795731 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:29.796577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:29.796577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:29.796577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:29.796577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:29.796577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:29.796577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:29.796577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:29.796577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:29.796577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:29.796577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:29.796577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:16:29.796577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:16:29.796577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:29.796577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:29.796577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 456/911] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Jul 26 10:16:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:29.803147 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30837ea1-fbb5-4a46-900d-7828a1c23c0b None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:29.913613 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30837ea1-fbb5-4a46-900d-7828a1c23c0b None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:29.952326 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f98365-9649-4c36-9af3-1f213e5c65cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:29.952949 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f98365-9649-4c36-9af3-1f213e5c65cd None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:29.953240 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f98365-9649-4c36-9af3-1f213e5c65cd None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:29.953499 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f98365-9649-4c36-9af3-1f213e5c65cd None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:29.954192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f98365-9649-4c36-9af3-1f213e5c65cd None admin] RBAC: Adding query filter params (name=placement) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:29.954536 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f98365-9649-4c36-9af3-1f213e5c65cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:29.955905 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f98365-9649-4c36-9af3-1f213e5c65cd None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:29.961728 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 456/912] 10.222.0.60 () {56 vars in 1116 bytes} [Tue Jul 26 10:16:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:29.970601 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d507d74-0ada-40b6-a5ed-b7d501d8377d None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:30.081738 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d507d74-0ada-40b6-a5ed-b7d501d8377d None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:30.117606 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1cc89-62bb-47f5-a0ee-7edc6ddfdb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:30.118212 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1cc89-62bb-47f5-a0ee-7edc6ddfdb2c None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:30.118490 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1cc89-62bb-47f5-a0ee-7edc6ddfdb2c None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:30.118785 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1cc89-62bb-47f5-a0ee-7edc6ddfdb2c None admin] PATH_INFO: `/v3/services` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:30.119444 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1cc89-62bb-47f5-a0ee-7edc6ddfdb2c None admin] RBAC: Adding query filter params (type=placement) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:30.119705 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1cc89-62bb-47f5-a0ee-7edc6ddfdb2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:30.121108 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1cc89-62bb-47f5-a0ee-7edc6ddfdb2c None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:30.126260 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 457/913] 10.222.0.60 () {56 vars in 1116 bytes} [Tue Jul 26 10:16:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:32.366980 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af043c-f790-4a30-a18d-fcfdeadc4267 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:32.367857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af043c-f790-4a30-a18d-fcfdeadc4267 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:32.367857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af043c-f790-4a30-a18d-fcfdeadc4267 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:32.369340 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 457/914] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:16:32.375302 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f022a28-f467-4b7a-92b3-556ef171f920 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:32.375805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f022a28-f467-4b7a-92b3-556ef171f920 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:32.375902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f022a28-f467-4b7a-92b3-556ef171f920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:32.396243 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-6f022a28-f467-4b7a-92b3-556ef171f920 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:16:32.397531 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-6f022a28-f467-4b7a-92b3-556ef171f920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:16:32.430150 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:32.478146 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 458/915] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:16:32 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:16:32.505388 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af043c-f790-4a30-a18d-fcfdeadc4267 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:32.539407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:32.618029 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af043c-f790-4a30-a18d-fcfdeadc4267 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:32.661368 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8adff9-5a78-4c84-aa75-7d1980ede7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:32.662019 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8adff9-5a78-4c84-aa75-7d1980ede7fd None admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:32.662300 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8adff9-5a78-4c84-aa75-7d1980ede7fd None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:32.662615 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8adff9-5a78-4c84-aa75-7d1980ede7fd None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:32.663802 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8adff9-5a78-4c84-aa75-7d1980ede7fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:32.664768 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8adff9-5a78-4c84-aa75-7d1980ede7fd None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:32.681325 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 458/916] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Jul 26 10:16:32 2022] POST /identity/v3/services => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:16:34.902095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b8fbb-5cee-4600-91c6-09b6c33a7214 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:34.903063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b8fbb-5cee-4600-91c6-09b6c33a7214 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:34.903315 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b8fbb-5cee-4600-91c6-09b6c33a7214 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:34.905067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 459/917] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:16:34.911525 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd354b-624f-4d28-a15b-a9ca23b95489 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:34.912375 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd354b-624f-4d28-a15b-a9ca23b95489 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:34.912375 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd354b-624f-4d28-a15b-a9ca23b95489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:34.935596 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-e2dd354b-624f-4d28-a15b-a9ca23b95489 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:16:34.936815 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-e2dd354b-624f-4d28-a15b-a9ca23b95489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:16:35.015621 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 459/918] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:16:34 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:16:35.040118 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b8fbb-5cee-4600-91c6-09b6c33a7214 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:35.154928 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b8fbb-5cee-4600-91c6-09b6c33a7214 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:35.191717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095982ca-9272-4bd1-b2cb-702184a4294c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:35.192374 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095982ca-9272-4bd1-b2cb-702184a4294c None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:35.192652 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095982ca-9272-4bd1-b2cb-702184a4294c None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:35.192905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095982ca-9272-4bd1-b2cb-702184a4294c None admin] PATH_INFO: `/v3/services/placement` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:35.193534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095982ca-9272-4bd1-b2cb-702184a4294c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:35.194983 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095982ca-9272-4bd1-b2cb-702184a4294c None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-095982ca-9272-4bd1-b2cb-702184a4294c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:35.204628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:35.205829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:35.206948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:35.206948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:35.206948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:35.206948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:35.206948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:35.206948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:35.206948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:35.206948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:35.206948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:35.206948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:35.206948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:16:35.206948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:16:35.206948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:35.206948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:35.206948 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 460/919] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Jul 26 10:16:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:35.212150 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd354b-624f-4d28-a15b-a9ca23b95489 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:35.231737 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:35.314929 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd354b-624f-4d28-a15b-a9ca23b95489 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:35.350631 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a341c9-95e9-48c8-b24d-212202cf298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:35.351298 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a341c9-95e9-48c8-b24d-212202cf298b None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:35.351579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a341c9-95e9-48c8-b24d-212202cf298b None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:35.351853 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a341c9-95e9-48c8-b24d-212202cf298b None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:35.352542 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a341c9-95e9-48c8-b24d-212202cf298b None admin] RBAC: Adding query filter params (name=placement) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:35.352839 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a341c9-95e9-48c8-b24d-212202cf298b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:35.354216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a341c9-95e9-48c8-b24d-212202cf298b None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:35.359786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 460/920] 10.222.0.60 () {56 vars in 1116 bytes} [Tue Jul 26 10:16:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:35.366120 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095982ca-9272-4bd1-b2cb-702184a4294c None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:35.397615 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:35.480866 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095982ca-9272-4bd1-b2cb-702184a4294c None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:35.516904 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba914d1f-e1e1-4d9e-8a1e-0d7d47e80ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:35.517547 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba914d1f-e1e1-4d9e-8a1e-0d7d47e80ff0 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:35.517826 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba914d1f-e1e1-4d9e-8a1e-0d7d47e80ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:35.518101 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba914d1f-e1e1-4d9e-8a1e-0d7d47e80ff0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:35.518914 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba914d1f-e1e1-4d9e-8a1e-0d7d47e80ff0 None admin] RBAC: Adding query filter params (interface=public, service_id=1c9ac0d881de40a1a6cda8808275ad33, region_id=RegionOne) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:35.519209 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba914d1f-e1e1-4d9e-8a1e-0d7d47e80ff0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:35.520681 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba914d1f-e1e1-4d9e-8a1e-0d7d47e80ff0 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:35.526562 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 461/921] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Jul 26 10:16:35 2022] GET /identity/v3/endpoints?service_id=1c9ac0d881de40a1a6cda8808275ad33&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:35.532821 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a341c9-95e9-48c8-b24d-212202cf298b None admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:35.622169 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:35.641734 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a341c9-95e9-48c8-b24d-212202cf298b None admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:35.679267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b9e1f-fb4a-4ec1-87f0-7d4a6294f219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:35.679938 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b9e1f-fb4a-4ec1-87f0-7d4a6294f219 None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:35.680219 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b9e1f-fb4a-4ec1-87f0-7d4a6294f219 None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:35.680494 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b9e1f-fb4a-4ec1-87f0-7d4a6294f219 None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:35.681163 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b9e1f-fb4a-4ec1-87f0-7d4a6294f219 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:35.682580 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b9e1f-fb4a-4ec1-87f0-7d4a6294f219 None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:35.690149 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 461/922] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Jul 26 10:16:35 2022] GET /identity/v3/services => generated 1962 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:16:37.912129 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a140f-40ab-4a1a-86f6-ea5fa89a8cd6 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:37.912733 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a140f-40ab-4a1a-86f6-ea5fa89a8cd6 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:37.912733 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a140f-40ab-4a1a-86f6-ea5fa89a8cd6 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:37.914110 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 462/923] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:16:37.920760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebeaaa-a5e8-4b23-945b-f4bc2d68f13f None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:37.921314 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebeaaa-a5e8-4b23-945b-f4bc2d68f13f None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:37.921314 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebeaaa-a5e8-4b23-945b-f4bc2d68f13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:37.940842 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-21ebeaaa-a5e8-4b23-945b-f4bc2d68f13f None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:16:37.942059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-21ebeaaa-a5e8-4b23-945b-f4bc2d68f13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:16:38.017033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 462/924] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:16:37 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:16:38.041250 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a140f-40ab-4a1a-86f6-ea5fa89a8cd6 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:38.148131 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:38.159173 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a140f-40ab-4a1a-86f6-ea5fa89a8cd6 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:38.195344 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6af8e-fe45-45e7-af44-73d5cf686878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:38.195888 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6af8e-fe45-45e7-af44-73d5cf686878 None admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:38.196160 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6af8e-fe45-45e7-af44-73d5cf686878 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:38.196424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6af8e-fe45-45e7-af44-73d5cf686878 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:38.197042 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6af8e-fe45-45e7-af44-73d5cf686878 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:38.198485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6af8e-fe45-45e7-af44-73d5cf686878 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application [None req-f2c6af8e-fe45-45e7-af44-73d5cf686878 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:38.208424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:38.209695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:38.210899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:38.210899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:38.210899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:38.210899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:38.210899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:38.210899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:38.210899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:38.210899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:38.210899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:38.210899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:38.210899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:16:38.210899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:16:38.210899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:38.210899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: ERROR keystone.server.flask.application Jul 26 10:16:38.210899 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 463/925] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Jul 26 10:16:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:38.215966 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebeaaa-a5e8-4b23-945b-f4bc2d68f13f None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:38.303190 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:38.330690 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebeaaa-a5e8-4b23-945b-f4bc2d68f13f None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:38.369176 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4594bc-ad82-4a2e-8f9c-eeeb1f0b791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:38.369820 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4594bc-ad82-4a2e-8f9c-eeeb1f0b791e None admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:38.370092 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4594bc-ad82-4a2e-8f9c-eeeb1f0b791e None admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:38.370359 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4594bc-ad82-4a2e-8f9c-eeeb1f0b791e None admin] PATH_INFO: `/v3/services` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:38.371107 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4594bc-ad82-4a2e-8f9c-eeeb1f0b791e None admin] RBAC: Adding query filter params (name=placement) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:38.371404 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4594bc-ad82-4a2e-8f9c-eeeb1f0b791e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:38.372794 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4594bc-ad82-4a2e-8f9c-eeeb1f0b791e None admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:38.378815 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 463/926] 10.222.0.60 () {56 vars in 1116 bytes} [Tue Jul 26 10:16:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:38.385401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6af8e-fe45-45e7-af44-73d5cf686878 None admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:38.494256 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6af8e-fe45-45e7-af44-73d5cf686878 None admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:38.531822 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9aa8b-5cbd-4a8d-87fa-87af5c2496d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:38.532455 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9aa8b-5cbd-4a8d-87fa-87af5c2496d6 None admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:38.532733 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9aa8b-5cbd-4a8d-87fa-87af5c2496d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:38.533006 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9aa8b-5cbd-4a8d-87fa-87af5c2496d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:38.533754 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9aa8b-5cbd-4a8d-87fa-87af5c2496d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:38.535200 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9aa8b-5cbd-4a8d-87fa-87af5c2496d6 None admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:38.562357 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 464/927] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Jul 26 10:16:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:16:48.375440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=30 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:48.554352 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:39.166791 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807a967-73a5-4f15-9579-ae669fa39377 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:39.167274 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807a967-73a5-4f15-9579-ae669fa39377 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:39.167478 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807a967-73a5-4f15-9579-ae669fa39377 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:39.169476 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 464/928] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:17:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:39.175531 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc99cd2-1bf7-4857-be5a-e34163c7a0c4 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:39.175996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc99cd2-1bf7-4857-be5a-e34163c7a0c4 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:39.176073 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc99cd2-1bf7-4857-be5a-e34163c7a0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:39.202980 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-abc99cd2-1bf7-4857-be5a-e34163c7a0c4 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:39.204238 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-abc99cd2-1bf7-4857-be5a-e34163c7a0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:39.301524 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 465/929] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:39.370947 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11789357-bdb6-4e82-9877-dbcf3c3350ca None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:39.371046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11789357-bdb6-4e82-9877-dbcf3c3350ca None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:39.371594 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11789357-bdb6-4e82-9877-dbcf3c3350ca None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:39.372778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 465/930] 10.222.0.60 () {54 vars in 965 bytes} [Tue Jul 26 10:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:39.384528 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9395a2-c46b-4570-a8d3-f6ef619f253a None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:39.385026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9395a2-c46b-4570-a8d3-f6ef619f253a None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:39.385424 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9395a2-c46b-4570-a8d3-f6ef619f253a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:39.463208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-9d9395a2-c46b-4570-a8d3-f6ef619f253a None None] MFA Rules not processed for user `c2ed2d73e1984404b8099b18a9bb7594`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:39.464488 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-9d9395a2-c46b-4570-a8d3-f6ef619f253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:39.548105 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 466/931] 10.222.0.60 () {58 vars in 1062 bytes} [Tue Jul 26 10:17:39 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:39.557635 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11789357-bdb6-4e82-9877-dbcf3c3350ca None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:39.570245 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11789357-bdb6-4e82-9877-dbcf3c3350ca None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:39.576296 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df8437-060e-4dda-ad3a-f0ecec458bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:39.577046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df8437-060e-4dda-ad3a-f0ecec458bed service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:39.577392 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df8437-060e-4dda-ad3a-f0ecec458bed service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:39.577730 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df8437-060e-4dda-ad3a-f0ecec458bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:39.588885 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df8437-060e-4dda-ad3a-f0ecec458bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:39.590726 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df8437-060e-4dda-ad3a-f0ecec458bed service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:39.601971 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 466/932] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:42.145776 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6eaea-1412-464c-8722-aed20599abc6 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:42.146320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6eaea-1412-464c-8722-aed20599abc6 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:42.146420 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6eaea-1412-464c-8722-aed20599abc6 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:42.147768 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 467/933] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:42.153755 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b417c-8197-46eb-97c2-7d8be0f7bdd2 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:42.154278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b417c-8197-46eb-97c2-7d8be0f7bdd2 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:42.154278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b417c-8197-46eb-97c2-7d8be0f7bdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:42.175108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-b60b417c-8197-46eb-97c2-7d8be0f7bdd2 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:42.176300 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-b60b417c-8197-46eb-97c2-7d8be0f7bdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:42.185079 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 467/934] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:17:42.238624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a227e0-4425-482c-beed-126a2773c2ce None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:42.239006 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a227e0-4425-482c-beed-126a2773c2ce None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:42.239153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a227e0-4425-482c-beed-126a2773c2ce None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:42.240776 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 468/935] 10.222.0.60 () {54 vars in 965 bytes} [Tue Jul 26 10:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:42.246903 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4c360-21a5-4e13-b25e-9a74ebaa20a9 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:42.247155 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4c360-21a5-4e13-b25e-9a74ebaa20a9 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:42.247452 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4c360-21a5-4e13-b25e-9a74ebaa20a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:42.268937 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-95c4c360-21a5-4e13-b25e-9a74ebaa20a9 None None] MFA Rules not processed for user `c2ed2d73e1984404b8099b18a9bb7594`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:42.270133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-95c4c360-21a5-4e13-b25e-9a74ebaa20a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:42.276979 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 468/936] 10.222.0.60 () {58 vars in 1062 bytes} [Tue Jul 26 10:17:42 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:42.286612 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a227e0-4425-482c-beed-126a2773c2ce None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:42.298766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a227e0-4425-482c-beed-126a2773c2ce None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:42.303651 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b489a8-fe62-490b-81f8-7ec187243820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:42.303651 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b489a8-fe62-490b-81f8-7ec187243820 service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:42.303651 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b489a8-fe62-490b-81f8-7ec187243820 service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:42.303997 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b489a8-fe62-490b-81f8-7ec187243820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:42.314650 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b489a8-fe62-490b-81f8-7ec187243820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:42.316109 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b489a8-fe62-490b-81f8-7ec187243820 service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:42.326495 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 469/937] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:45.152180 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e0056-32e2-4b67-846f-29be1d99d924 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:45.152945 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e0056-32e2-4b67-846f-29be1d99d924 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:45.152945 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e0056-32e2-4b67-846f-29be1d99d924 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:45.154261 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 469/938] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:45.159967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e030f-42f9-44d1-a317-173041597a48 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:45.160477 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e030f-42f9-44d1-a317-173041597a48 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:45.160477 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e030f-42f9-44d1-a317-173041597a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:45.205165 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-bc2e030f-42f9-44d1-a317-173041597a48 None None] MFA Rules not processed for user `2ea2941f7ce84e2c852c62634e0e040a`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:45.206365 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-bc2e030f-42f9-44d1-a317-173041597a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:45.252756 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:45.284629 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 470/939] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:45 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:45.325227 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e0056-32e2-4b67-846f-29be1d99d924 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:45.340038 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e0056-32e2-4b67-846f-29be1d99d924 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:45.344849 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e6dd1-7346-40de-813d-bf22483ae735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:45.345589 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e6dd1-7346-40de-813d-bf22483ae735 service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:45.345996 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e6dd1-7346-40de-813d-bf22483ae735 service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:45.346336 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e6dd1-7346-40de-813d-bf22483ae735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:45.357884 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e6dd1-7346-40de-813d-bf22483ae735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:45.359494 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e6dd1-7346-40de-813d-bf22483ae735 service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:45.370288 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 470/940] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:45 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:48.551995 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3f159-f67f-4844-98a3-b669805f3f9f None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:48.552614 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3f159-f67f-4844-98a3-b669805f3f9f None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:48.552614 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3f159-f67f-4844-98a3-b669805f3f9f None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:48.553913 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 471/941] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:48.559970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6ae1c-3d8a-468d-ab1a-1e3ff51773eb None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:48.560513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6ae1c-3d8a-468d-ab1a-1e3ff51773eb None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:48.560513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6ae1c-3d8a-468d-ab1a-1e3ff51773eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:48.584143 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-efb6ae1c-3d8a-468d-ab1a-1e3ff51773eb None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:48.585414 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-efb6ae1c-3d8a-468d-ab1a-1e3ff51773eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:48.675505 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 471/942] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:48 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:48.716636 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3f159-f67f-4844-98a3-b669805f3f9f None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:48.728845 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3f159-f67f-4844-98a3-b669805f3f9f None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:48.732667 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235728c-d45f-4c14-8df7-46756e24e39f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:48.733308 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235728c-d45f-4c14-8df7-46756e24e39f service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:48.733589 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235728c-d45f-4c14-8df7-46756e24e39f service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:48.733865 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235728c-d45f-4c14-8df7-46756e24e39f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:48.744080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235728c-d45f-4c14-8df7-46756e24e39f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:48.745685 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235728c-d45f-4c14-8df7-46756e24e39f service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:48.756938 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 472/943] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:48 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:51.747802 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9825e1-23bb-4825-b2c0-4548d6312c21 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:51.748627 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9825e1-23bb-4825-b2c0-4548d6312c21 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:51.748627 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9825e1-23bb-4825-b2c0-4548d6312c21 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:51.749735 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 472/944] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:51.755155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ed1b3-6a1d-413b-9bf7-04b706d2c20b None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:51.755583 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ed1b3-6a1d-413b-9bf7-04b706d2c20b None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:51.755742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ed1b3-6a1d-413b-9bf7-04b706d2c20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:51.776228 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-519ed1b3-6a1d-413b-9bf7-04b706d2c20b None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:51.777437 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-519ed1b3-6a1d-413b-9bf7-04b706d2c20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:51.787316 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 473/945] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:51.824311 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9825e1-23bb-4825-b2c0-4548d6312c21 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:51.836729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9825e1-23bb-4825-b2c0-4548d6312c21 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:51.840624 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfdd7a-0dfc-4f0b-9990-516de28187c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:51.841241 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfdd7a-0dfc-4f0b-9990-516de28187c3 service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:51.841517 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfdd7a-0dfc-4f0b-9990-516de28187c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:51.841787 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfdd7a-0dfc-4f0b-9990-516de28187c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:51.850987 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfdd7a-0dfc-4f0b-9990-516de28187c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:51.852440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfdd7a-0dfc-4f0b-9990-516de28187c3 service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:51.862245 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 473/946] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:54.157346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e9b4a-1bc6-4b9e-8810-fe0ddca60ae8 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:54.157888 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e9b4a-1bc6-4b9e-8810-fe0ddca60ae8 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:54.157888 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e9b4a-1bc6-4b9e-8810-fe0ddca60ae8 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:54.159318 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 474/947] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:54.168819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa23c92-f4ac-4800-b92e-08909fb96546 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:54.168819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa23c92-f4ac-4800-b92e-08909fb96546 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:54.168819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa23c92-f4ac-4800-b92e-08909fb96546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:54.192859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-4aa23c92-f4ac-4800-b92e-08909fb96546 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:54.194982 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-4aa23c92-f4ac-4800-b92e-08909fb96546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:54.207792 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 474/948] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:17:54.246414 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e9b4a-1bc6-4b9e-8810-fe0ddca60ae8 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:54.258344 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e9b4a-1bc6-4b9e-8810-fe0ddca60ae8 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:54.262268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24c1eb-ea90-408b-b55c-9fc2b5c7cd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:54.262970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24c1eb-ea90-408b-b55c-9fc2b5c7cd23 service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:54.263214 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24c1eb-ea90-408b-b55c-9fc2b5c7cd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:54.263514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24c1eb-ea90-408b-b55c-9fc2b5c7cd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:54.273997 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24c1eb-ea90-408b-b55c-9fc2b5c7cd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:54.275430 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24c1eb-ea90-408b-b55c-9fc2b5c7cd23 service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:54.286862 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 475/949] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:56.691426 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4171f40-f9eb-490a-80ca-bc6d43f3e7e1 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:56.691426 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4171f40-f9eb-490a-80ca-bc6d43f3e7e1 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:56.691426 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4171f40-f9eb-490a-80ca-bc6d43f3e7e1 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:56.692470 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 475/950] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:56.698394 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49096d2f-9a3f-4426-bfd3-65cf959d16a0 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:56.698961 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49096d2f-9a3f-4426-bfd3-65cf959d16a0 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:56.698961 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49096d2f-9a3f-4426-bfd3-65cf959d16a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:56.720469 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-49096d2f-9a3f-4426-bfd3-65cf959d16a0 None None] MFA Rules not processed for user `2ea2941f7ce84e2c852c62634e0e040a`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:56.721728 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-49096d2f-9a3f-4426-bfd3-65cf959d16a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:56.730776 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 476/951] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:56 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:17:56.772200 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4171f40-f9eb-490a-80ca-bc6d43f3e7e1 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:56.785150 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4171f40-f9eb-490a-80ca-bc6d43f3e7e1 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:56.789077 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55037cf-f396-40a1-8b5d-67515feea506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:56.789714 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55037cf-f396-40a1-8b5d-67515feea506 service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:56.789997 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55037cf-f396-40a1-8b5d-67515feea506 service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:56.790267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55037cf-f396-40a1-8b5d-67515feea506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:56.800716 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55037cf-f396-40a1-8b5d-67515feea506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:56.802178 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55037cf-f396-40a1-8b5d-67515feea506 service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:56.813609 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 476/952] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:56 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:59.424058 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3eb90a-e7f0-411c-a98d-bb7c0d8ce3ff None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:59.424698 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3eb90a-e7f0-411c-a98d-bb7c0d8ce3ff None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:59.424698 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3eb90a-e7f0-411c-a98d-bb7c0d8ce3ff None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:59.426057 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 477/953] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:59.434672 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3912d0c-7818-4ea3-bd83-ebf8f2588c80 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:59.435341 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3912d0c-7818-4ea3-bd83-ebf8f2588c80 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:59.435619 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3912d0c-7818-4ea3-bd83-ebf8f2588c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:59.459373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-d3912d0c-7818-4ea3-bd83-ebf8f2588c80 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:59.460257 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-d3912d0c-7818-4ea3-bd83-ebf8f2588c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:59.471991 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 477/954] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:59.513678 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3eb90a-e7f0-411c-a98d-bb7c0d8ce3ff None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:59.526609 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3eb90a-e7f0-411c-a98d-bb7c0d8ce3ff None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:59.530957 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b02d44-ed0c-4570-b612-53ece6b484fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:59.531688 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b02d44-ed0c-4570-b612-53ece6b484fd service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:59.532375 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b02d44-ed0c-4570-b612-53ece6b484fd service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:59.532743 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b02d44-ed0c-4570-b612-53ece6b484fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:59.544248 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b02d44-ed0c-4570-b612-53ece6b484fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:59.545759 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b02d44-ed0c-4570-b612-53ece6b484fd service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:59.557319 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 478/955] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:01.900872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07231976-0f24-43ab-a975-a2123129aab6 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:01.901477 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07231976-0f24-43ab-a975-a2123129aab6 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:01.901477 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07231976-0f24-43ab-a975-a2123129aab6 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:01.902819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 478/956] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:18:01.909031 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db51c9-30cf-49c6-8532-d8088107f33c None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:01.909655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db51c9-30cf-49c6-8532-d8088107f33c None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:01.909655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db51c9-30cf-49c6-8532-d8088107f33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:01.930620 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-16db51c9-30cf-49c6-8532-d8088107f33c None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:01.931666 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-16db51c9-30cf-49c6-8532-d8088107f33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:01.942379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 479/957] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:01.983307 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07231976-0f24-43ab-a975-a2123129aab6 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:01.994463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07231976-0f24-43ab-a975-a2123129aab6 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:01.998144 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea199e7-dea1-4830-8e9f-ea0e331374b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:01.998809 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea199e7-dea1-4830-8e9f-ea0e331374b4 service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:01.999084 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea199e7-dea1-4830-8e9f-ea0e331374b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:01.999430 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea199e7-dea1-4830-8e9f-ea0e331374b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:02.009655 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea199e7-dea1-4830-8e9f-ea0e331374b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:02.011203 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea199e7-dea1-4830-8e9f-ea0e331374b4 service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:02.021762 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 479/958] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:04.853224 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043c5e0-cfcb-40ab-97c6-02a4ed34ce0b None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:04.853793 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043c5e0-cfcb-40ab-97c6-02a4ed34ce0b None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:04.853927 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043c5e0-cfcb-40ab-97c6-02a4ed34ce0b None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:04.856390 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 480/959] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:04.862740 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3823e-216d-4d65-9a80-373154b0f02e None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:04.863574 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3823e-216d-4d65-9a80-373154b0f02e None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:04.863574 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3823e-216d-4d65-9a80-373154b0f02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:04.886388 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-edf3823e-216d-4d65-9a80-373154b0f02e None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:04.887741 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-edf3823e-216d-4d65-9a80-373154b0f02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:04.897057 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 480/960] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:04 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:04.938747 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043c5e0-cfcb-40ab-97c6-02a4ed34ce0b None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:04.951150 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043c5e0-cfcb-40ab-97c6-02a4ed34ce0b None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:04.955128 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d0974-caf5-417d-8bc2-fc264c312a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:04.955794 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d0974-caf5-417d-8bc2-fc264c312a34 service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:04.956072 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d0974-caf5-417d-8bc2-fc264c312a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:04.956347 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d0974-caf5-417d-8bc2-fc264c312a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:04.966934 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d0974-caf5-417d-8bc2-fc264c312a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:04.968408 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d0974-caf5-417d-8bc2-fc264c312a34 service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:04.979451 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 481/961] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:04 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:09.535940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553026f-2aad-4b4c-b7a0-30661a8be778 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:09.536541 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553026f-2aad-4b4c-b7a0-30661a8be778 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:09.536541 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553026f-2aad-4b4c-b7a0-30661a8be778 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:09.537829 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 481/962] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:09.545464 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af25131-d68f-4af3-a8cc-6c7cb1c681f9 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:09.545979 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af25131-d68f-4af3-a8cc-6c7cb1c681f9 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:09.546171 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af25131-d68f-4af3-a8cc-6c7cb1c681f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:09.569521 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-5af25131-d68f-4af3-a8cc-6c7cb1c681f9 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:09.571001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-5af25131-d68f-4af3-a8cc-6c7cb1c681f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:09.580578 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 482/963] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:09.621648 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553026f-2aad-4b4c-b7a0-30661a8be778 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:09.628500 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=77 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:09.636495 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553026f-2aad-4b4c-b7a0-30661a8be778 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:09.641250 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f724171-3329-4b00-9c01-032ea65d2897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:09.642220 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f724171-3329-4b00-9c01-032ea65d2897 service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:09.642519 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f724171-3329-4b00-9c01-032ea65d2897 service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:09.642836 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f724171-3329-4b00-9c01-032ea65d2897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:09.655167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f724171-3329-4b00-9c01-032ea65d2897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:09.655904 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f724171-3329-4b00-9c01-032ea65d2897 service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:09.666759 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 482/964] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:13.208674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38cd96-59e6-4591-8cf0-f1f3a3a56232 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:13.209308 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38cd96-59e6-4591-8cf0-f1f3a3a56232 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:13.209475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38cd96-59e6-4591-8cf0-f1f3a3a56232 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:13.212220 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 483/965] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:13.219947 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99fa4c-35c7-4080-83aa-503a7b28ca0b None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:13.220520 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99fa4c-35c7-4080-83aa-503a7b28ca0b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:13.220620 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99fa4c-35c7-4080-83aa-503a7b28ca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:13.243297 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-ca99fa4c-35c7-4080-83aa-503a7b28ca0b None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:13.244545 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-ca99fa4c-35c7-4080-83aa-503a7b28ca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:13.258475 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 483/966] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:13 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:13.297950 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38cd96-59e6-4591-8cf0-f1f3a3a56232 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:13.309468 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38cd96-59e6-4591-8cf0-f1f3a3a56232 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:13.314344 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c41e8-3215-400e-98c3-2a495f8fa4ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:13.314344 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c41e8-3215-400e-98c3-2a495f8fa4ef service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:13.314344 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c41e8-3215-400e-98c3-2a495f8fa4ef service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:13.314868 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c41e8-3215-400e-98c3-2a495f8fa4ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:13.325413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c41e8-3215-400e-98c3-2a495f8fa4ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:13.326942 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c41e8-3215-400e-98c3-2a495f8fa4ef service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:13.337726 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 484/967] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:13 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:18.364799 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43841696-34cd-4454-a6f1-c7df463bee27 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:18.365329 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43841696-34cd-4454-a6f1-c7df463bee27 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:18.365329 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43841696-34cd-4454-a6f1-c7df463bee27 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:18.366740 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 484/968] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:18.372396 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92a2e1-d63c-473a-9461-2dd044c81f65 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:18.372892 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92a2e1-d63c-473a-9461-2dd044c81f65 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:18.372997 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92a2e1-d63c-473a-9461-2dd044c81f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:18.380713 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=54 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:18.395433 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-2d92a2e1-d63c-473a-9461-2dd044c81f65 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:18.396602 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-2d92a2e1-d63c-473a-9461-2dd044c81f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:18.404723 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 485/969] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:18.444623 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43841696-34cd-4454-a6f1-c7df463bee27 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:18.457024 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43841696-34cd-4454-a6f1-c7df463bee27 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:18.461920 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c614b-62df-4e1a-a581-dd735aa8ab5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:18.461920 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c614b-62df-4e1a-a581-dd735aa8ab5d service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:18.462301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c614b-62df-4e1a-a581-dd735aa8ab5d service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:18.462301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c614b-62df-4e1a-a581-dd735aa8ab5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:18.473643 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c614b-62df-4e1a-a581-dd735aa8ab5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:18.476654 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c614b-62df-4e1a-a581-dd735aa8ab5d service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:18.487983 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 485/970] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:24.129964 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daffb08-7aeb-4586-86c9-869d13a7c5c2 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:24.130792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daffb08-7aeb-4586-86c9-869d13a7c5c2 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:24.131240 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daffb08-7aeb-4586-86c9-869d13a7c5c2 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:24.132795 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 486/971] 10.222.0.60 () {54 vars in 921 bytes} [Tue Jul 26 10:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:24.140314 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590c5a1-96a8-4801-b63b-6db477b84f85 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:24.140770 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590c5a1-96a8-4801-b63b-6db477b84f85 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:24.140861 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590c5a1-96a8-4801-b63b-6db477b84f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:24.211792 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-a590c5a1-96a8-4801-b63b-6db477b84f85 None None] MFA Rules not processed for user `32a61a4fe5c74444af1afdbeaf9be512`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:24.214212 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-a590c5a1-96a8-4801-b63b-6db477b84f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:24.309208 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 486/972] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Jul 26 10:18:24 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:28.390741 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=2 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:28.907019 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a77fb4-e4e1-4d51-95e4-7f6823bfef68 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:28.907785 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a77fb4-e4e1-4d51-95e4-7f6823bfef68 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:28.907913 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a77fb4-e4e1-4d51-95e4-7f6823bfef68 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:28.909448 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 487/973] 10.222.0.60 () {54 vars in 921 bytes} [Tue Jul 26 10:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:28.914423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92669cee-477c-43ef-bd4d-bcb0f664afd7 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:28.914953 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92669cee-477c-43ef-bd4d-bcb0f664afd7 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:28.915330 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92669cee-477c-43ef-bd4d-bcb0f664afd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:28.936485 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-92669cee-477c-43ef-bd4d-bcb0f664afd7 None None] MFA Rules not processed for user `32a61a4fe5c74444af1afdbeaf9be512`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:28.937706 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-92669cee-477c-43ef-bd4d-bcb0f664afd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:28.947794 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 487/974] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Jul 26 10:18:28 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:30.655583 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cec70-17ee-4e46-b184-c7563cc09eee None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:30.656220 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cec70-17ee-4e46-b184-c7563cc09eee None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:30.656220 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cec70-17ee-4e46-b184-c7563cc09eee None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:30.658051 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 488/975] 10.222.0.60 () {54 vars in 921 bytes} [Tue Jul 26 10:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:30.663572 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94b0d9-78f3-4b56-aaa6-63ef2d1e2865 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:30.664087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94b0d9-78f3-4b56-aaa6-63ef2d1e2865 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:30.664204 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94b0d9-78f3-4b56-aaa6-63ef2d1e2865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:30.692490 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-ce94b0d9-78f3-4b56-aaa6-63ef2d1e2865 None None] MFA Rules not processed for user `32a61a4fe5c74444af1afdbeaf9be512`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:30.693744 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-ce94b0d9-78f3-4b56-aaa6-63ef2d1e2865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:30.703531 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 488/976] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Jul 26 10:18:30 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:34.651135 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f9b64-ac34-489e-bd0e-817f334e8e29 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:34.652063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f9b64-ac34-489e-bd0e-817f334e8e29 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:34.652507 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f9b64-ac34-489e-bd0e-817f334e8e29 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:34.654062 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 489/977] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:34.663264 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ea882-7de8-40a9-bd07-e6ae5963c730 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:34.664165 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ea882-7de8-40a9-bd07-e6ae5963c730 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:34.664636 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ea882-7de8-40a9-bd07-e6ae5963c730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:34.684843 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-629ea882-7de8-40a9-bd07-e6ae5963c730 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:34.686074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-629ea882-7de8-40a9-bd07-e6ae5963c730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:34.694073 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 489/978] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:34.749990 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40500341-1ffa-41c3-a846-d870cc9832b6 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:34.750832 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40500341-1ffa-41c3-a846-d870cc9832b6 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:34.751266 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40500341-1ffa-41c3-a846-d870cc9832b6 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:34.753056 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 490/979] 10.222.0.60 () {54 vars in 962 bytes} [Tue Jul 26 10:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:34.761044 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9f898-f7e1-49df-b02e-9e0e25c418d2 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:34.761332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9f898-f7e1-49df-b02e-9e0e25c418d2 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:34.761611 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9f898-f7e1-49df-b02e-9e0e25c418d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:34.808328 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-cad9f898-f7e1-49df-b02e-9e0e25c418d2 None None] MFA Rules not processed for user `d68b323bc2b54984ad2ed0d248675624`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:34.809803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-cad9f898-f7e1-49df-b02e-9e0e25c418d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:34.883581 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:34.892712 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 490/980] 10.222.0.60 () {58 vars in 1059 bytes} [Tue Jul 26 10:18:34 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:34.898655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40500341-1ffa-41c3-a846-d870cc9832b6 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:34.913160 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40500341-1ffa-41c3-a846-d870cc9832b6 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:34.918124 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f656b-4354-4f35-a500-36380a980d88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:34.918777 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f656b-4354-4f35-a500-36380a980d88 service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:34.919055 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f656b-4354-4f35-a500-36380a980d88 service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:34.919321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f656b-4354-4f35-a500-36380a980d88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:34.929441 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f656b-4354-4f35-a500-36380a980d88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:34.931368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f656b-4354-4f35-a500-36380a980d88 service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:34.945601 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 491/981] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:37.398783 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1e9b0-db9d-419e-b9a6-b4b2123a3c10 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:37.399407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1e9b0-db9d-419e-b9a6-b4b2123a3c10 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:37.399407 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1e9b0-db9d-419e-b9a6-b4b2123a3c10 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:37.401252 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 491/982] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:37.407798 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6391e6-3e37-4a4f-a559-923ce57b687d None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:37.408434 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6391e6-3e37-4a4f-a559-923ce57b687d None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:37.408434 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6391e6-3e37-4a4f-a559-923ce57b687d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:37.557641 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-ea6391e6-3e37-4a4f-a559-923ce57b687d None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:37.558805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-ea6391e6-3e37-4a4f-a559-923ce57b687d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:37.567329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 492/983] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:37.615435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1e9b0-db9d-419e-b9a6-b4b2123a3c10 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:37.631315 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1e9b0-db9d-419e-b9a6-b4b2123a3c10 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:37.636567 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5792d1-0683-4329-a4b7-766ed46c91de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:37.637308 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5792d1-0683-4329-a4b7-766ed46c91de service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:37.637690 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5792d1-0683-4329-a4b7-766ed46c91de service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:37.638063 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5792d1-0683-4329-a4b7-766ed46c91de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:37.647721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5792d1-0683-4329-a4b7-766ed46c91de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:37.649518 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5792d1-0683-4329-a4b7-766ed46c91de service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:37.673282 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 492/984] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:40.320264 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dacfc9-9ea2-4630-9337-b78c3d136c5a None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:40.320759 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dacfc9-9ea2-4630-9337-b78c3d136c5a None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:40.320759 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dacfc9-9ea2-4630-9337-b78c3d136c5a None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:40.322127 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 493/985] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:40.327384 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718fb3e-ef50-4e3d-8f19-d87373372b7b None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:40.327837 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718fb3e-ef50-4e3d-8f19-d87373372b7b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:40.327933 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718fb3e-ef50-4e3d-8f19-d87373372b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:40.347640 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-e718fb3e-ef50-4e3d-8f19-d87373372b7b None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:40.348861 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-e718fb3e-ef50-4e3d-8f19-d87373372b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:40.366794 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 493/986] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:40.404009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769cc16-974c-48f6-844a-35c0a9125af5 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:40.404288 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769cc16-974c-48f6-844a-35c0a9125af5 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:40.404563 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769cc16-974c-48f6-844a-35c0a9125af5 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:40.405896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 494/987] 10.222.0.60 () {54 vars in 962 bytes} [Tue Jul 26 10:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:40.412018 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673b038-f96c-4ce4-bc11-f83902fcd09e None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:40.412613 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673b038-f96c-4ce4-bc11-f83902fcd09e None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:40.413090 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673b038-f96c-4ce4-bc11-f83902fcd09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:40.434311 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-9673b038-f96c-4ce4-bc11-f83902fcd09e None None] MFA Rules not processed for user `d68b323bc2b54984ad2ed0d248675624`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:40.435810 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-9673b038-f96c-4ce4-bc11-f83902fcd09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:40.444640 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 494/988] 10.222.0.60 () {58 vars in 1059 bytes} [Tue Jul 26 10:18:40 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:40.454174 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769cc16-974c-48f6-844a-35c0a9125af5 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:40.471876 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769cc16-974c-48f6-844a-35c0a9125af5 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:40.476942 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262ce9a-96b0-4734-8318-b1142cfbe342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:40.477556 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262ce9a-96b0-4734-8318-b1142cfbe342 service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:40.477826 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262ce9a-96b0-4734-8318-b1142cfbe342 service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:40.478090 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262ce9a-96b0-4734-8318-b1142cfbe342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:40.486963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262ce9a-96b0-4734-8318-b1142cfbe342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:40.488541 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262ce9a-96b0-4734-8318-b1142cfbe342 service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:40.498086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 495/989] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:42.846220 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae1dac-4ab0-4374-a4ff-eddb83a82a77 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:42.847112 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae1dac-4ab0-4374-a4ff-eddb83a82a77 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:42.847531 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae1dac-4ab0-4374-a4ff-eddb83a82a77 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:42.855086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f44a6-d578-40b8-a751-a3e18b5faa4a None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:42.855902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f44a6-d578-40b8-a751-a3e18b5faa4a None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:42.856338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f44a6-d578-40b8-a751-a3e18b5faa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:42.859667 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 495/990] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:42 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:42.876625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-830f44a6-d578-40b8-a751-a3e18b5faa4a None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:42.878096 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-830f44a6-d578-40b8-a751-a3e18b5faa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:42.894792 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 496/991] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:42.934307 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae1dac-4ab0-4374-a4ff-eddb83a82a77 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:42.948936 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae1dac-4ab0-4374-a4ff-eddb83a82a77 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:42.954213 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774eecf-c89e-49bc-b843-ef9e276da83e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:42.955029 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774eecf-c89e-49bc-b843-ef9e276da83e service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:42.955453 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774eecf-c89e-49bc-b843-ef9e276da83e service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:42.955892 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774eecf-c89e-49bc-b843-ef9e276da83e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:42.965206 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774eecf-c89e-49bc-b843-ef9e276da83e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:42.967024 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774eecf-c89e-49bc-b843-ef9e276da83e service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:42.988796 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 496/992] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:44.933849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a2a80-8fce-4ffa-8c6b-1a6c99562811 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:44.934344 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a2a80-8fce-4ffa-8c6b-1a6c99562811 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:44.934564 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a2a80-8fce-4ffa-8c6b-1a6c99562811 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:44.936534 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 497/993] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:44.943492 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f8ffa-71ed-416d-8a8f-b5244466bce5 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:44.943950 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f8ffa-71ed-416d-8a8f-b5244466bce5 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:44.944028 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f8ffa-71ed-416d-8a8f-b5244466bce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:44.965728 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-127f8ffa-71ed-416d-8a8f-b5244466bce5 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:44.966899 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-127f8ffa-71ed-416d-8a8f-b5244466bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:44.983782 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 497/994] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:45.289549 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4e696-5dd1-4a5c-a042-55ac61fc255f None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:45.289810 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4e696-5dd1-4a5c-a042-55ac61fc255f None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:45.290075 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4e696-5dd1-4a5c-a042-55ac61fc255f None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:45.291750 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 498/995] 10.222.0.60 () {54 vars in 964 bytes} [Tue Jul 26 10:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:45.296899 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4efbe5-2f24-487d-ba40-376ef376f773 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:45.297183 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4efbe5-2f24-487d-ba40-376ef376f773 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:45.297450 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4efbe5-2f24-487d-ba40-376ef376f773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:45.338714 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-8b4efbe5-2f24-487d-ba40-376ef376f773 None None] MFA Rules not processed for user `6a2272bbc60f47fc929b1cc352533f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:45.340550 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-8b4efbe5-2f24-487d-ba40-376ef376f773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:45.403122 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bd93a-ab97-4179-b650-128ecbfaf41c None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:45.403380 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bd93a-ab97-4179-b650-128ecbfaf41c None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:45.403461 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bd93a-ab97-4179-b650-128ecbfaf41c None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:45.404822 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 499/996] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:45.409330 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 498/997] 10.222.0.60 () {58 vars in 1061 bytes} [Tue Jul 26 10:18:45 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:45.411438 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd6d09-3b5b-441d-bfbb-837696a1ebc5 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:45.411955 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd6d09-3b5b-441d-bfbb-837696a1ebc5 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:45.412545 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd6d09-3b5b-441d-bfbb-837696a1ebc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:45.417729 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4efbe5-2f24-487d-ba40-376ef376f773 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:45.427267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4efbe5-2f24-487d-ba40-376ef376f773 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:45.431149 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86be23-3498-49db-b6b4-0a5027c85ffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2272bbc60f47fc929b1cc352533f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:45.432081 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86be23-3498-49db-b6b4-0a5027c85ffd service cinder] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:45.432576 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86be23-3498-49db-b6b4-0a5027c85ffd service cinder] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:45.432993 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86be23-3498-49db-b6b4-0a5027c85ffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:45.441385 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-71cd6d09-3b5b-441d-bfbb-837696a1ebc5 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:45.443096 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-71cd6d09-3b5b-441d-bfbb-837696a1ebc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:45.444269 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86be23-3498-49db-b6b4-0a5027c85ffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:45.446726 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86be23-3498-49db-b6b4-0a5027c85ffd service cinder] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:45.452693 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 500/998] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:18:45.461155 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 499/999] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:18:45.500132 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd6d09-3b5b-441d-bfbb-837696a1ebc5 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:45.513095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd6d09-3b5b-441d-bfbb-837696a1ebc5 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:45.518755 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658df091-fbf9-49fc-93f6-950043db4eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:45.519422 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658df091-fbf9-49fc-93f6-950043db4eba service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:45.519761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658df091-fbf9-49fc-93f6-950043db4eba service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:45.520086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658df091-fbf9-49fc-93f6-950043db4eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:45.529701 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658df091-fbf9-49fc-93f6-950043db4eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:45.531796 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658df091-fbf9-49fc-93f6-950043db4eba service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:45.543441 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 501/1000] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:47.895942 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7630bf-f3ad-443c-8b45-c7386120e524 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:47.896530 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7630bf-f3ad-443c-8b45-c7386120e524 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:47.896530 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7630bf-f3ad-443c-8b45-c7386120e524 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:47.897834 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 500/1001] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:47.903992 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c39046-9fa4-4a56-b47d-6d8eb00abd2f None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:47.904467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c39046-9fa4-4a56-b47d-6d8eb00abd2f None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:47.904572 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c39046-9fa4-4a56-b47d-6d8eb00abd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:47.925394 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-34c39046-9fa4-4a56-b47d-6d8eb00abd2f None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:47.926989 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-34c39046-9fa4-4a56-b47d-6d8eb00abd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:47.936165 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 502/1002] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:47.984274 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7630bf-f3ad-443c-8b45-c7386120e524 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:47.999146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7630bf-f3ad-443c-8b45-c7386120e524 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:48.004561 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927100b7-0bd9-4fc1-a75a-417badba21be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:48.005213 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927100b7-0bd9-4fc1-a75a-417badba21be service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:48.005491 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927100b7-0bd9-4fc1-a75a-417badba21be service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:48.005923 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927100b7-0bd9-4fc1-a75a-417badba21be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:48.022723 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927100b7-0bd9-4fc1-a75a-417badba21be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:48.024332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927100b7-0bd9-4fc1-a75a-417badba21be service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:48.036110 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 501/1003] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:50.373111 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c22d2-07d7-42a4-8fc8-5955b9c822c2 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:50.373704 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c22d2-07d7-42a4-8fc8-5955b9c822c2 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:50.373704 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c22d2-07d7-42a4-8fc8-5955b9c822c2 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:50.374910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 503/1004] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:50.380864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6decf61-62b2-4c61-b312-95fc8170b98d None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:50.381398 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6decf61-62b2-4c61-b312-95fc8170b98d None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:50.381509 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6decf61-62b2-4c61-b312-95fc8170b98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:50.402156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-f6decf61-62b2-4c61-b312-95fc8170b98d None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:50.403420 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-f6decf61-62b2-4c61-b312-95fc8170b98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:50.412542 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 502/1005] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:50.455762 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c22d2-07d7-42a4-8fc8-5955b9c822c2 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:50.472223 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c22d2-07d7-42a4-8fc8-5955b9c822c2 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:50.478871 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c4f92-d8bd-4603-b07b-f9bc713abf00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:50.479554 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c4f92-d8bd-4603-b07b-f9bc713abf00 service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:50.479816 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c4f92-d8bd-4603-b07b-f9bc713abf00 service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:50.480086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c4f92-d8bd-4603-b07b-f9bc713abf00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:50.490621 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c4f92-d8bd-4603-b07b-f9bc713abf00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:50.492257 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c4f92-d8bd-4603-b07b-f9bc713abf00 service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:50.503440 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 504/1006] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:52.786470 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36429cda-4380-4875-9419-610b6a8a4c3c None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:52.787035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36429cda-4380-4875-9419-610b6a8a4c3c None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:52.787035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36429cda-4380-4875-9419-610b6a8a4c3c None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:52.788353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 503/1007] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:52.794078 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2cdb7-d7ba-4829-b989-1227488ed5db None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:52.794617 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2cdb7-d7ba-4829-b989-1227488ed5db None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:52.794617 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2cdb7-d7ba-4829-b989-1227488ed5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:52.814525 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-2dc2cdb7-d7ba-4829-b989-1227488ed5db None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:52.816010 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-2dc2cdb7-d7ba-4829-b989-1227488ed5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:52.824156 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 505/1008] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:52.873208 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36429cda-4380-4875-9419-610b6a8a4c3c None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:52.887446 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36429cda-4380-4875-9419-610b6a8a4c3c None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:52.892568 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46850d6f-d0de-43c1-aa1e-3c0c551bdb0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:52.893218 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46850d6f-d0de-43c1-aa1e-3c0c551bdb0c service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:52.893562 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46850d6f-d0de-43c1-aa1e-3c0c551bdb0c service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:52.893884 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46850d6f-d0de-43c1-aa1e-3c0c551bdb0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:52.902889 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46850d6f-d0de-43c1-aa1e-3c0c551bdb0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:52.904558 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46850d6f-d0de-43c1-aa1e-3c0c551bdb0c service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:52.915122 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 504/1009] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:55.278015 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdf32d-fabf-41ae-8bf1-71f88ba2a018 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:55.278644 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdf32d-fabf-41ae-8bf1-71f88ba2a018 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:55.278644 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdf32d-fabf-41ae-8bf1-71f88ba2a018 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:55.279952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 506/1010] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:55.288222 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc551fbf-1cf6-4a65-b0c2-f889a6f92fa0 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:55.288955 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc551fbf-1cf6-4a65-b0c2-f889a6f92fa0 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:55.288955 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc551fbf-1cf6-4a65-b0c2-f889a6f92fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:55.314968 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-fc551fbf-1cf6-4a65-b0c2-f889a6f92fa0 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:55.316343 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-fc551fbf-1cf6-4a65-b0c2-f889a6f92fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:55.325169 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 505/1011] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:55.377872 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdf32d-fabf-41ae-8bf1-71f88ba2a018 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:55.398130 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdf32d-fabf-41ae-8bf1-71f88ba2a018 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:55.406766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed36592-29ff-44b8-ac17-1e9f7c1f2b46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:55.408153 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed36592-29ff-44b8-ac17-1e9f7c1f2b46 service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:55.408511 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed36592-29ff-44b8-ac17-1e9f7c1f2b46 service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:55.408891 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed36592-29ff-44b8-ac17-1e9f7c1f2b46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:55.424586 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed36592-29ff-44b8-ac17-1e9f7c1f2b46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:55.427520 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed36592-29ff-44b8-ac17-1e9f7c1f2b46 service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:55.443739 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 507/1012] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:57.947214 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecae8d-0730-4e15-a5e3-bd547e65acba None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:57.948906 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecae8d-0730-4e15-a5e3-bd547e65acba None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:57.948906 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecae8d-0730-4e15-a5e3-bd547e65acba None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:57.949417 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 506/1013] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:18:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:18:57.956439 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de51e4-2307-4c4c-9f7e-f46bf753d9ea None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:57.957407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de51e4-2307-4c4c-9f7e-f46bf753d9ea None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:57.957407 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de51e4-2307-4c4c-9f7e-f46bf753d9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:57.980436 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-52de51e4-2307-4c4c-9f7e-f46bf753d9ea None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:57.981799 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-52de51e4-2307-4c4c-9f7e-f46bf753d9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:57.993379 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 508/1014] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:58.043444 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecae8d-0730-4e15-a5e3-bd547e65acba None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:58.065546 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecae8d-0730-4e15-a5e3-bd547e65acba None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:58.073300 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7eab3-c014-4638-9a86-d581aec18ead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:58.073988 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7eab3-c014-4638-9a86-d581aec18ead service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:58.074338 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7eab3-c014-4638-9a86-d581aec18ead service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:58.074668 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7eab3-c014-4638-9a86-d581aec18ead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:58.085669 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7eab3-c014-4638-9a86-d581aec18ead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:58.087490 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7eab3-c014-4638-9a86-d581aec18ead service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:58.100224 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 507/1015] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:01.123785 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195f7b8-fad3-43f3-a62e-31c5e1d4aaad None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:01.124446 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195f7b8-fad3-43f3-a62e-31c5e1d4aaad None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:01.124446 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195f7b8-fad3-43f3-a62e-31c5e1d4aaad None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:01.125649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 509/1016] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:01.131272 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff993d-7d4e-4e2f-826a-d8d32e7a642b None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:01.131875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff993d-7d4e-4e2f-826a-d8d32e7a642b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:01.131875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff993d-7d4e-4e2f-826a-d8d32e7a642b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:01.154858 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-f5ff993d-7d4e-4e2f-826a-d8d32e7a642b None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:01.156406 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-f5ff993d-7d4e-4e2f-826a-d8d32e7a642b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:01.166848 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 508/1017] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:19:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:01.212720 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195f7b8-fad3-43f3-a62e-31c5e1d4aaad None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:01.220530 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=49 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:01.235329 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195f7b8-fad3-43f3-a62e-31c5e1d4aaad None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:01.240789 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45585122-ba84-43c5-837e-69d4271df89a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:01.241436 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45585122-ba84-43c5-837e-69d4271df89a service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:01.241706 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45585122-ba84-43c5-837e-69d4271df89a service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:01.241967 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45585122-ba84-43c5-837e-69d4271df89a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:01.251970 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45585122-ba84-43c5-837e-69d4271df89a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:01.253643 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45585122-ba84-43c5-837e-69d4271df89a service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:01.265182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 510/1018] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:01.408599 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6c064-6b82-4c05-8453-0767876b8c1e None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:01.408993 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6c064-6b82-4c05-8453-0767876b8c1e None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:01.409099 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6c064-6b82-4c05-8453-0767876b8c1e None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:01.410659 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 509/1019] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:01.416845 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b8219-c25a-4f4a-b895-5517eaf7a886 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:01.417200 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b8219-c25a-4f4a-b895-5517eaf7a886 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:01.417561 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b8219-c25a-4f4a-b895-5517eaf7a886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:01.440054 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-fc9b8219-c25a-4f4a-b895-5517eaf7a886 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:01.441313 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-fc9b8219-c25a-4f4a-b895-5517eaf7a886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:01.451907 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 511/1020] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:19:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:01.511677 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a422c-81e8-4df3-a8be-7536afc82941 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:01.512043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a422c-81e8-4df3-a8be-7536afc82941 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:01.512380 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a422c-81e8-4df3-a8be-7536afc82941 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:01.513884 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 510/1021] 10.222.0.60 () {54 vars in 966 bytes} [Tue Jul 26 10:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:01.519346 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7feae-4996-436a-98f8-dd0b78e26ff7 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:01.519628 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7feae-4996-436a-98f8-dd0b78e26ff7 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:01.519906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7feae-4996-436a-98f8-dd0b78e26ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:01.559588 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-8ec7feae-4996-436a-98f8-dd0b78e26ff7 None None] MFA Rules not processed for user `7f4adbb70e9f46f9a6a416329e8c0bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:01.560695 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-8ec7feae-4996-436a-98f8-dd0b78e26ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:01.627840 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 512/1022] 10.222.0.60 () {58 vars in 1063 bytes} [Tue Jul 26 10:19:01 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:01.635491 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a422c-81e8-4df3-a8be-7536afc82941 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:01.647080 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a422c-81e8-4df3-a8be-7536afc82941 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:01.651037 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10d1f6-82ea-4847-bb51-c7a2f1e85852 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4adbb70e9f46f9a6a416329e8c0bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:01.651780 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10d1f6-82ea-4847-bb51-c7a2f1e85852 service glance] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:01.652100 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10d1f6-82ea-4847-bb51-c7a2f1e85852 service glance] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:01.652442 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10d1f6-82ea-4847-bb51-c7a2f1e85852 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:01.663191 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10d1f6-82ea-4847-bb51-c7a2f1e85852 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:01.664777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10d1f6-82ea-4847-bb51-c7a2f1e85852 service glance] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:01.675372 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 511/1023] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:03.566853 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6ea25-8846-4c77-a2e9-21db05748943 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:03.567498 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6ea25-8846-4c77-a2e9-21db05748943 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:03.567498 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6ea25-8846-4c77-a2e9-21db05748943 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:03.568897 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 513/1024] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:03.574748 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41fe81-32a5-4aeb-8874-cd1062791ad5 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:03.575336 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41fe81-32a5-4aeb-8874-cd1062791ad5 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:03.575336 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41fe81-32a5-4aeb-8874-cd1062791ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:03.595884 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-1d41fe81-32a5-4aeb-8874-cd1062791ad5 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:03.597146 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-1d41fe81-32a5-4aeb-8874-cd1062791ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:03.607186 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 512/1025] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:19:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:03.655518 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6ea25-8846-4c77-a2e9-21db05748943 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:03.697467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6ea25-8846-4c77-a2e9-21db05748943 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:03.707551 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb32f5c-6cbb-4d68-a59a-b4bf30eb0946 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:03.708213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb32f5c-6cbb-4d68-a59a-b4bf30eb0946 service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:03.710140 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb32f5c-6cbb-4d68-a59a-b4bf30eb0946 service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:03.710692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb32f5c-6cbb-4d68-a59a-b4bf30eb0946 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:03.730805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb32f5c-6cbb-4d68-a59a-b4bf30eb0946 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:03.733922 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb32f5c-6cbb-4d68-a59a-b4bf30eb0946 service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:03.755552 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 514/1026] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:13.590478 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=97 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:13.749472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=47 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:17.175133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664adc5-c30f-418b-b568-187235c4fd44 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:17.175802 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664adc5-c30f-418b-b568-187235c4fd44 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:17.175802 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664adc5-c30f-418b-b568-187235c4fd44 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:17.177053 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 513/1027] 10.222.0.60 () {54 vars in 918 bytes} [Tue Jul 26 10:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:17.182364 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac5ab8-34b1-4584-95c6-40d3c641e70a None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:17.182887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac5ab8-34b1-4584-95c6-40d3c641e70a None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:17.182995 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac5ab8-34b1-4584-95c6-40d3c641e70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:17.204069 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-b8ac5ab8-34b1-4584-95c6-40d3c641e70a None None] MFA Rules not processed for user `32a61a4fe5c74444af1afdbeaf9be512`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:17.205344 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-b8ac5ab8-34b1-4584-95c6-40d3c641e70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:17.215335 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 515/1028] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Jul 26 10:19:17 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:17.232117 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669920ba-6cb5-45d0-8e0c-df87604e2ece None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:17.232393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669920ba-6cb5-45d0-8e0c-df87604e2ece None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:17.232661 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669920ba-6cb5-45d0-8e0c-df87604e2ece None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:17.234029 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 514/1029] 10.222.0.60 () {54 vars in 918 bytes} [Tue Jul 26 10:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:17.239553 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958ffb6-626c-4eeb-be92-ece36d76a4d1 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:17.239845 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958ffb6-626c-4eeb-be92-ece36d76a4d1 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:17.240110 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958ffb6-626c-4eeb-be92-ece36d76a4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:17.264427 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-3958ffb6-626c-4eeb-be92-ece36d76a4d1 None None] MFA Rules not processed for user `d68b323bc2b54984ad2ed0d248675624`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:17.266268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-3958ffb6-626c-4eeb-be92-ece36d76a4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:17.276107 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 516/1030] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Jul 26 10:19:17 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:20.011153 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55e702-685a-45df-89f5-4917268f0b2b None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:20.011754 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55e702-685a-45df-89f5-4917268f0b2b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:20.011871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55e702-685a-45df-89f5-4917268f0b2b None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:20.013200 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 515/1031] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:20.018933 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87460250-0b5a-47d5-a963-110b92b1564a None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:20.019933 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87460250-0b5a-47d5-a963-110b92b1564a None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:20.019933 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87460250-0b5a-47d5-a963-110b92b1564a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:20.041012 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-87460250-0b5a-47d5-a963-110b92b1564a None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:20.042253 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-87460250-0b5a-47d5-a963-110b92b1564a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:20.051391 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 517/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:20.096206 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55e702-685a-45df-89f5-4917268f0b2b None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:20.111464 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55e702-685a-45df-89f5-4917268f0b2b None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:20.116438 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4871fe-edfa-4e1a-afd2-d2fd7055a149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:20.117059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4871fe-edfa-4e1a-afd2-d2fd7055a149 service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:20.117338 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4871fe-edfa-4e1a-afd2-d2fd7055a149 service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:20.117611 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4871fe-edfa-4e1a-afd2-d2fd7055a149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:20.126620 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4871fe-edfa-4e1a-afd2-d2fd7055a149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:20.128285 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4871fe-edfa-4e1a-afd2-d2fd7055a149 service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:20.138409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 516/1033] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:21.103597 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc5da7-8046-47eb-912a-026cac0d87c0 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:21.104218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc5da7-8046-47eb-912a-026cac0d87c0 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:21.104218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc5da7-8046-47eb-912a-026cac0d87c0 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:21.105543 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 518/1034] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:21.111943 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb156b-91fa-4b9b-be68-d35ef901e400 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:21.112473 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb156b-91fa-4b9b-be68-d35ef901e400 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:21.113168 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb156b-91fa-4b9b-be68-d35ef901e400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:21.134231 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-d5cb156b-91fa-4b9b-be68-d35ef901e400 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:21.135515 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-d5cb156b-91fa-4b9b-be68-d35ef901e400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:21.144423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 517/1035] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:21.382629 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc5da7-8046-47eb-912a-026cac0d87c0 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:21.398493 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc5da7-8046-47eb-912a-026cac0d87c0 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:21.405273 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725761ac-213f-4427-9384-aede72451be1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:21.406294 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725761ac-213f-4427-9384-aede72451be1 service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:21.406794 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725761ac-213f-4427-9384-aede72451be1 service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:21.407573 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725761ac-213f-4427-9384-aede72451be1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:21.423157 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725761ac-213f-4427-9384-aede72451be1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:21.426169 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725761ac-213f-4427-9384-aede72451be1 service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:21.439805 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 519/1036] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:22.344299 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb003c-cbf2-4aa0-a2c0-f69033b8d6c8 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:22.345144 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb003c-cbf2-4aa0-a2c0-f69033b8d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:22.345144 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb003c-cbf2-4aa0-a2c0-f69033b8d6c8 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:22.347409 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 518/1037] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:22.352493 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2742e83-11e9-43cd-815e-dfe433e45ea8 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:22.352984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2742e83-11e9-43cd-815e-dfe433e45ea8 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:22.352984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2742e83-11e9-43cd-815e-dfe433e45ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:22.379597 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-f2742e83-11e9-43cd-815e-dfe433e45ea8 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:22.380829 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-f2742e83-11e9-43cd-815e-dfe433e45ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:22.389654 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 520/1038] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:22.551376 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb003c-cbf2-4aa0-a2c0-f69033b8d6c8 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:22.571552 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb003c-cbf2-4aa0-a2c0-f69033b8d6c8 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:22.577793 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99596d31-7534-4637-9f78-35b36c515795 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:22.578488 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99596d31-7534-4637-9f78-35b36c515795 service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:22.578736 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99596d31-7534-4637-9f78-35b36c515795 service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:22.578985 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99596d31-7534-4637-9f78-35b36c515795 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:22.589835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99596d31-7534-4637-9f78-35b36c515795 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:22.591518 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99596d31-7534-4637-9f78-35b36c515795 service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:22.603127 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 519/1039] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:23.488196 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a291b-9e91-4080-bbde-5d27d272246e None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:23.488801 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a291b-9e91-4080-bbde-5d27d272246e None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:23.488801 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a291b-9e91-4080-bbde-5d27d272246e None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:23.490239 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 521/1040] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:23.495679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad3e09-4c42-420e-9ecf-c0222786e04c None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:23.496211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad3e09-4c42-420e-9ecf-c0222786e04c None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:23.496211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad3e09-4c42-420e-9ecf-c0222786e04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:23.517238 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-90ad3e09-4c42-420e-9ecf-c0222786e04c None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:23.518466 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-90ad3e09-4c42-420e-9ecf-c0222786e04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:23.526693 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 520/1041] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:23.682709 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a291b-9e91-4080-bbde-5d27d272246e None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:23.696360 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a291b-9e91-4080-bbde-5d27d272246e None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:23.701518 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ad565-f57b-4726-b749-31776b0f47dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:23.702139 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ad565-f57b-4726-b749-31776b0f47dc service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:23.702420 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ad565-f57b-4726-b749-31776b0f47dc service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:23.702724 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ad565-f57b-4726-b749-31776b0f47dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:23.711736 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ad565-f57b-4726-b749-31776b0f47dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:23.713310 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ad565-f57b-4726-b749-31776b0f47dc service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:23.723726 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 522/1042] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:24.616725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f7c09-e68b-4283-b366-72aa731f9794 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:24.617388 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f7c09-e68b-4283-b366-72aa731f9794 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:24.617388 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f7c09-e68b-4283-b366-72aa731f9794 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:24.618703 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 521/1043] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:24.624363 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bcc81-6c0a-4819-abf9-14db46db2212 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:24.624907 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bcc81-6c0a-4819-abf9-14db46db2212 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:24.624907 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bcc81-6c0a-4819-abf9-14db46db2212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:24.644365 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-7e7bcc81-6c0a-4819-abf9-14db46db2212 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:24.645544 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-7e7bcc81-6c0a-4819-abf9-14db46db2212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:24.653724 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 523/1044] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:24.809486 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f7c09-e68b-4283-b366-72aa731f9794 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:24.824427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f7c09-e68b-4283-b366-72aa731f9794 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:24.831324 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b7729-4560-4046-bbdf-bf9fd03c42e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:24.832184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b7729-4560-4046-bbdf-bf9fd03c42e7 service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:24.832518 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b7729-4560-4046-bbdf-bf9fd03c42e7 service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:24.832813 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b7729-4560-4046-bbdf-bf9fd03c42e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:24.844959 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b7729-4560-4046-bbdf-bf9fd03c42e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:24.846660 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b7729-4560-4046-bbdf-bf9fd03c42e7 service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:24.857542 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 522/1045] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:25.659611 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9cfb5-9ac0-4892-a86a-9562333f9c7e None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:25.660229 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9cfb5-9ac0-4892-a86a-9562333f9c7e None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:25.660229 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9cfb5-9ac0-4892-a86a-9562333f9c7e None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:25.661508 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 524/1046] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:25.666838 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b72e0-2cf0-47ea-8f26-1995ac4a1bd7 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:25.667318 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b72e0-2cf0-47ea-8f26-1995ac4a1bd7 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:25.667410 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b72e0-2cf0-47ea-8f26-1995ac4a1bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:25.689087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-c27b72e0-2cf0-47ea-8f26-1995ac4a1bd7 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:25.690325 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-c27b72e0-2cf0-47ea-8f26-1995ac4a1bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:25.699561 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 523/1047] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:25.854201 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9cfb5-9ac0-4892-a86a-9562333f9c7e None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:25.869462 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9cfb5-9ac0-4892-a86a-9562333f9c7e None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:25.876108 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256949f8-3cc1-4bfb-a3d0-df4b6a869e5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:25.876781 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256949f8-3cc1-4bfb-a3d0-df4b6a869e5e service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:25.877085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256949f8-3cc1-4bfb-a3d0-df4b6a869e5e service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:25.877285 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256949f8-3cc1-4bfb-a3d0-df4b6a869e5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:25.887458 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256949f8-3cc1-4bfb-a3d0-df4b6a869e5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:25.889092 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256949f8-3cc1-4bfb-a3d0-df4b6a869e5e service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:25.899804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 525/1048] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:26.713615 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5e42c-824a-420d-a0ac-b07f22f36b2e None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:26.714189 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5e42c-824a-420d-a0ac-b07f22f36b2e None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:26.714189 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5e42c-824a-420d-a0ac-b07f22f36b2e None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:26.715611 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 524/1049] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:26.720848 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4eaef7-b378-49ba-9a1b-e4cec95d242d None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:26.721316 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4eaef7-b378-49ba-9a1b-e4cec95d242d None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:26.721440 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4eaef7-b378-49ba-9a1b-e4cec95d242d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:26.741941 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-0f4eaef7-b378-49ba-9a1b-e4cec95d242d None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:26.743094 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-0f4eaef7-b378-49ba-9a1b-e4cec95d242d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:26.759202 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 526/1050] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:26.914281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5e42c-824a-420d-a0ac-b07f22f36b2e None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:26.930016 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5e42c-824a-420d-a0ac-b07f22f36b2e None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:26.937297 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a22df-aaa1-4181-89d6-39dd6f79174b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:26.938020 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a22df-aaa1-4181-89d6-39dd6f79174b service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:26.938305 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a22df-aaa1-4181-89d6-39dd6f79174b service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:26.938840 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a22df-aaa1-4181-89d6-39dd6f79174b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:26.949777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a22df-aaa1-4181-89d6-39dd6f79174b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:26.951441 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a22df-aaa1-4181-89d6-39dd6f79174b service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:26.963605 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 525/1051] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:27.781514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5254a-9582-40b6-8286-d2acd03dec67 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:27.782545 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5254a-9582-40b6-8286-d2acd03dec67 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:27.782545 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5254a-9582-40b6-8286-d2acd03dec67 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:27.783857 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 527/1052] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:27.789010 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc709ba1-3ea3-48bc-a9a5-e7cfa2b1698f None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:27.789510 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc709ba1-3ea3-48bc-a9a5-e7cfa2b1698f None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:27.789510 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc709ba1-3ea3-48bc-a9a5-e7cfa2b1698f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:27.810576 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-fc709ba1-3ea3-48bc-a9a5-e7cfa2b1698f None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:27.811788 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-fc709ba1-3ea3-48bc-a9a5-e7cfa2b1698f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:27.821350 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 526/1053] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:27.975327 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5254a-9582-40b6-8286-d2acd03dec67 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:27.989836 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5254a-9582-40b6-8286-d2acd03dec67 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:27.995847 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7390bf-6a49-4377-94cf-3bf05f4b4e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:27.996515 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7390bf-6a49-4377-94cf-3bf05f4b4e43 service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:27.996791 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7390bf-6a49-4377-94cf-3bf05f4b4e43 service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:27.997058 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7390bf-6a49-4377-94cf-3bf05f4b4e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:28.007338 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7390bf-6a49-4377-94cf-3bf05f4b4e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:28.008972 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7390bf-6a49-4377-94cf-3bf05f4b4e43 service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:28.021390 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 528/1054] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:28.834167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a5260-869c-4243-9efb-2f0301021f94 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:28.834740 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a5260-869c-4243-9efb-2f0301021f94 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:28.834740 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a5260-869c-4243-9efb-2f0301021f94 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:28.836932 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 527/1055] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:28.844678 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a47c53-b743-4bbc-bdb5-df48df313f61 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:28.845358 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a47c53-b743-4bbc-bdb5-df48df313f61 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:28.845521 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a47c53-b743-4bbc-bdb5-df48df313f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:28.869294 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-33a47c53-b743-4bbc-bdb5-df48df313f61 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:28.870484 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-33a47c53-b743-4bbc-bdb5-df48df313f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:28.879879 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 529/1056] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:29.033391 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a5260-869c-4243-9efb-2f0301021f94 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:29.052587 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a5260-869c-4243-9efb-2f0301021f94 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:29.058312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4fef5-b6e2-44fd-8bc5-ddaf07d063c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:29.059030 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4fef5-b6e2-44fd-8bc5-ddaf07d063c1 service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:29.059313 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4fef5-b6e2-44fd-8bc5-ddaf07d063c1 service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:29.059589 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4fef5-b6e2-44fd-8bc5-ddaf07d063c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:29.069416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4fef5-b6e2-44fd-8bc5-ddaf07d063c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:29.071065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4fef5-b6e2-44fd-8bc5-ddaf07d063c1 service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:29.081452 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 528/1057] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:31.186022 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9469d90-1832-40fb-828c-2c5c2970aaa5 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:31.186629 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9469d90-1832-40fb-828c-2c5c2970aaa5 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:31.186629 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9469d90-1832-40fb-828c-2c5c2970aaa5 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:31.187956 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 530/1058] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:31.193948 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7a3fb-7719-4c2b-98d5-b01cfd2712b7 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:31.194518 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7a3fb-7719-4c2b-98d5-b01cfd2712b7 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:31.194518 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7a3fb-7719-4c2b-98d5-b01cfd2712b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:31.215188 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-15d7a3fb-7719-4c2b-98d5-b01cfd2712b7 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:31.216421 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-15d7a3fb-7719-4c2b-98d5-b01cfd2712b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:31.225046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 529/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:31.265645 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9469d90-1832-40fb-828c-2c5c2970aaa5 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:31.277621 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9469d90-1832-40fb-828c-2c5c2970aaa5 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:31.281771 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc4342-2bf8-43bc-b1d0-3e8e434a8710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:31.282770 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4342-2bf8-43bc-b1d0-3e8e434a8710 service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:31.283043 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4342-2bf8-43bc-b1d0-3e8e434a8710 service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:31.283316 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4342-2bf8-43bc-b1d0-3e8e434a8710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:31.293268 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc4342-2bf8-43bc-b1d0-3e8e434a8710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:31.294737 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc4342-2bf8-43bc-b1d0-3e8e434a8710 service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:31.304620 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 531/1060] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:33.763828 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b9b21-7a3e-4fd2-9879-4d705ff88e13 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:33.764399 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b9b21-7a3e-4fd2-9879-4d705ff88e13 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:33.764399 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b9b21-7a3e-4fd2-9879-4d705ff88e13 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:33.766490 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 530/1061] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:33.774819 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6026d-991a-4af1-898a-927b5f88adb0 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:33.775225 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6026d-991a-4af1-898a-927b5f88adb0 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:33.775339 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6026d-991a-4af1-898a-927b5f88adb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:33.797103 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-14d6026d-991a-4af1-898a-927b5f88adb0 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:33.798360 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-14d6026d-991a-4af1-898a-927b5f88adb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:33.807698 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 532/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:33.851059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b9b21-7a3e-4fd2-9879-4d705ff88e13 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:33.869160 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b9b21-7a3e-4fd2-9879-4d705ff88e13 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:33.874110 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b25d46-d843-4094-b8eb-5210279bbcd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:33.874761 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b25d46-d843-4094-b8eb-5210279bbcd9 service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:33.875069 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b25d46-d843-4094-b8eb-5210279bbcd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:33.875343 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b25d46-d843-4094-b8eb-5210279bbcd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:33.885177 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b25d46-d843-4094-b8eb-5210279bbcd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:33.886845 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b25d46-d843-4094-b8eb-5210279bbcd9 service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:33.909460 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 531/1063] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:36.510593 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65ce9a-078b-4d78-b36c-1aced036a468 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:36.511147 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65ce9a-078b-4d78-b36c-1aced036a468 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:36.511147 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65ce9a-078b-4d78-b36c-1aced036a468 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:36.512736 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 533/1064] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:36.518628 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc84f50-e5f0-4f3c-a18b-847cea4406e2 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:36.519090 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc84f50-e5f0-4f3c-a18b-847cea4406e2 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:36.519209 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc84f50-e5f0-4f3c-a18b-847cea4406e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:36.541644 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-4cc84f50-e5f0-4f3c-a18b-847cea4406e2 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:36.543062 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-4cc84f50-e5f0-4f3c-a18b-847cea4406e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:36.552254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 532/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:36.592704 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65ce9a-078b-4d78-b36c-1aced036a468 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:36.604198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65ce9a-078b-4d78-b36c-1aced036a468 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:36.608088 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac96f0-7d1c-4f67-840e-619f27567218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:36.608710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac96f0-7d1c-4f67-840e-619f27567218 service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:36.608983 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac96f0-7d1c-4f67-840e-619f27567218 service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:36.609251 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac96f0-7d1c-4f67-840e-619f27567218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:36.619937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac96f0-7d1c-4f67-840e-619f27567218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:36.621466 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac96f0-7d1c-4f67-840e-619f27567218 service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:36.631839 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 534/1066] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:39.041485 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0cf8b-262e-4409-8dac-ee3e8c29775b None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:39.042081 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0cf8b-262e-4409-8dac-ee3e8c29775b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:39.042081 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0cf8b-262e-4409-8dac-ee3e8c29775b None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:39.043486 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 533/1067] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:39.050040 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b367fb-2bc9-4efc-bcb1-2760c48f2941 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:39.050655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b367fb-2bc9-4efc-bcb1-2760c48f2941 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:39.050873 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b367fb-2bc9-4efc-bcb1-2760c48f2941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:39.078861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-a4b367fb-2bc9-4efc-bcb1-2760c48f2941 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:39.080655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-a4b367fb-2bc9-4efc-bcb1-2760c48f2941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:39.092980 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 535/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:39.133591 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0cf8b-262e-4409-8dac-ee3e8c29775b None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:39.146155 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0cf8b-262e-4409-8dac-ee3e8c29775b None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:39.150064 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aefa0-be7b-418b-ad7b-f4bfdaff7e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:39.150761 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aefa0-be7b-418b-ad7b-f4bfdaff7e8d service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:39.151064 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aefa0-be7b-418b-ad7b-f4bfdaff7e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:39.151332 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aefa0-be7b-418b-ad7b-f4bfdaff7e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:39.162654 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aefa0-be7b-418b-ad7b-f4bfdaff7e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:39.163997 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aefa0-be7b-418b-ad7b-f4bfdaff7e8d service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:39.175192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 534/1069] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:41.469281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce6f4c-6d86-4756-b66e-73660b3a2d5b None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:41.470490 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce6f4c-6d86-4756-b66e-73660b3a2d5b None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:41.470683 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce6f4c-6d86-4756-b66e-73660b3a2d5b None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:41.472939 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 536/1070] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:41.481171 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab3b2-d58f-442d-b661-7151b7b09fe6 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:41.481685 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab3b2-d58f-442d-b661-7151b7b09fe6 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:41.481685 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab3b2-d58f-442d-b661-7151b7b09fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:41.503414 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-8dfab3b2-d58f-442d-b661-7151b7b09fe6 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:41.504635 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-8dfab3b2-d58f-442d-b661-7151b7b09fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:41.514202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 535/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:41.555851 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce6f4c-6d86-4756-b66e-73660b3a2d5b None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:41.568499 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce6f4c-6d86-4756-b66e-73660b3a2d5b None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:41.572742 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df5559-4799-40fb-91df-72359bf96ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:41.573360 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df5559-4799-40fb-91df-72359bf96ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:41.573635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df5559-4799-40fb-91df-72359bf96ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:41.573945 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df5559-4799-40fb-91df-72359bf96ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:41.584145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df5559-4799-40fb-91df-72359bf96ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:41.585591 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df5559-4799-40fb-91df-72359bf96ed3 service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:41.596289 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 537/1072] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:43.882422 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7600c1e-0e0f-4d0a-8488-b7e44afa1ec4 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:43.883451 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7600c1e-0e0f-4d0a-8488-b7e44afa1ec4 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:43.883451 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7600c1e-0e0f-4d0a-8488-b7e44afa1ec4 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:43.885614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 536/1073] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:43.891100 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287b7a1-7ee5-455b-a6b6-c80a17bcdc36 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:43.891538 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287b7a1-7ee5-455b-a6b6-c80a17bcdc36 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:43.891631 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287b7a1-7ee5-455b-a6b6-c80a17bcdc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:43.899234 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=70 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:43.912736 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-b287b7a1-7ee5-455b-a6b6-c80a17bcdc36 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:43.913853 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-b287b7a1-7ee5-455b-a6b6-c80a17bcdc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:43.922191 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 538/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:43.962108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7600c1e-0e0f-4d0a-8488-b7e44afa1ec4 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:43.971098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=64 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:43.979167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7600c1e-0e0f-4d0a-8488-b7e44afa1ec4 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:43.983922 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9f9ac-da74-4168-a552-abf7478f44df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:43.984553 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9f9ac-da74-4168-a552-abf7478f44df service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:43.984826 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9f9ac-da74-4168-a552-abf7478f44df service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:43.985073 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9f9ac-da74-4168-a552-abf7478f44df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:43.995846 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9f9ac-da74-4168-a552-abf7478f44df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:43.997304 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9f9ac-da74-4168-a552-abf7478f44df service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:44.007986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 537/1075] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:46.336442 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731c6a3-f87b-4acd-b6c5-c01ee0f20bd8 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:46.336963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731c6a3-f87b-4acd-b6c5-c01ee0f20bd8 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:46.336963 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731c6a3-f87b-4acd-b6c5-c01ee0f20bd8 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:46.338721 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 539/1076] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:46.345471 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3432648-bab8-48df-930f-85d06b289acf None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:46.346052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3432648-bab8-48df-930f-85d06b289acf None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:46.346052 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3432648-bab8-48df-930f-85d06b289acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:46.373304 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-d3432648-bab8-48df-930f-85d06b289acf None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:46.374542 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-d3432648-bab8-48df-930f-85d06b289acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:46.383134 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 538/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:46.423016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731c6a3-f87b-4acd-b6c5-c01ee0f20bd8 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:46.435406 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731c6a3-f87b-4acd-b6c5-c01ee0f20bd8 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:46.439446 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0faefd3-1c92-40eb-a152-4512e98b0384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:46.440062 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faefd3-1c92-40eb-a152-4512e98b0384 service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:46.440331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faefd3-1c92-40eb-a152-4512e98b0384 service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:46.440590 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faefd3-1c92-40eb-a152-4512e98b0384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:46.452707 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0faefd3-1c92-40eb-a152-4512e98b0384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:46.454526 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0faefd3-1c92-40eb-a152-4512e98b0384 service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:46.465185 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 540/1078] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:48.760940 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fabaa7-f4c8-4e60-af39-c6dbf69e957b None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:48.761520 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fabaa7-f4c8-4e60-af39-c6dbf69e957b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:48.761520 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fabaa7-f4c8-4e60-af39-c6dbf69e957b None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:48.762869 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 539/1079] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:48.768351 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ccdd-481d-4d45-b4a5-79648e6856e2 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:48.768810 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ccdd-481d-4d45-b4a5-79648e6856e2 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:48.769019 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ccdd-481d-4d45-b4a5-79648e6856e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:48.789543 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-e2e5ccdd-481d-4d45-b4a5-79648e6856e2 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:48.790804 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-e2e5ccdd-481d-4d45-b4a5-79648e6856e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:48.799636 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 541/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:48.838388 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fabaa7-f4c8-4e60-af39-c6dbf69e957b None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:48.850464 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fabaa7-f4c8-4e60-af39-c6dbf69e957b None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:48.854768 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb832c7d-d826-4621-b115-90813cdb257f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:48.855397 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb832c7d-d826-4621-b115-90813cdb257f service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:48.855696 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb832c7d-d826-4621-b115-90813cdb257f service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:48.855949 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb832c7d-d826-4621-b115-90813cdb257f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:48.866883 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb832c7d-d826-4621-b115-90813cdb257f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:48.868330 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb832c7d-d826-4621-b115-90813cdb257f service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:48.878577 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 540/1081] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:51.143624 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee37a18-2da4-4a23-b197-6587a2e3601d None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:51.144255 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee37a18-2da4-4a23-b197-6587a2e3601d None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:51.144255 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee37a18-2da4-4a23-b197-6587a2e3601d None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:51.145481 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 542/1082] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:51.151711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfece02-4a4a-4277-8e71-57949be2b7dc None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:51.152439 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfece02-4a4a-4277-8e71-57949be2b7dc None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:51.152439 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfece02-4a4a-4277-8e71-57949be2b7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:51.174786 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-abfece02-4a4a-4277-8e71-57949be2b7dc None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:51.176030 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-abfece02-4a4a-4277-8e71-57949be2b7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:51.185852 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 541/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:51.224690 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee37a18-2da4-4a23-b197-6587a2e3601d None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:51.236638 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee37a18-2da4-4a23-b197-6587a2e3601d None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:51.240475 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74ce5b-bff9-4db6-9865-86d839390e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:51.241095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74ce5b-bff9-4db6-9865-86d839390e9c service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:51.241397 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74ce5b-bff9-4db6-9865-86d839390e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:51.241632 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74ce5b-bff9-4db6-9865-86d839390e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:51.251583 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74ce5b-bff9-4db6-9865-86d839390e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:51.253047 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74ce5b-bff9-4db6-9865-86d839390e9c service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:51.262906 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 543/1084] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:53.522027 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea42ed0-2e8c-44f9-9613-db1109559bf0 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:53.522719 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea42ed0-2e8c-44f9-9613-db1109559bf0 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:53.522719 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea42ed0-2e8c-44f9-9613-db1109559bf0 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:53.524006 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 542/1085] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:53.530010 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30105327-f7b0-466f-9345-419d88ca4826 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:53.530572 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30105327-f7b0-466f-9345-419d88ca4826 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:53.530572 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30105327-f7b0-466f-9345-419d88ca4826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:53.555427 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-30105327-f7b0-466f-9345-419d88ca4826 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:53.556685 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-30105327-f7b0-466f-9345-419d88ca4826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:53.566480 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 544/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:53.604802 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea42ed0-2e8c-44f9-9613-db1109559bf0 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:53.617369 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea42ed0-2e8c-44f9-9613-db1109559bf0 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:53.621484 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0278d-aab4-450a-98c9-ce35b5a853c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:53.622102 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0278d-aab4-450a-98c9-ce35b5a853c6 service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:53.622380 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0278d-aab4-450a-98c9-ce35b5a853c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:53.622679 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0278d-aab4-450a-98c9-ce35b5a853c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:53.633501 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0278d-aab4-450a-98c9-ce35b5a853c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:53.634997 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0278d-aab4-450a-98c9-ce35b5a853c6 service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:53.645084 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 543/1087] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:20:03.549952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=20 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:03.640537 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=23 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:17.258692 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d5c1f-f9fd-48d8-8afb-0a6f3f649ba6 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:17.259465 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d5c1f-f9fd-48d8-8afb-0a6f3f649ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:17.259465 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d5c1f-f9fd-48d8-8afb-0a6f3f649ba6 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:17.260785 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 545/1088] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:20:17.270553 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e896c-e065-4e57-8387-4de059a56a60 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:17.271084 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e896c-e065-4e57-8387-4de059a56a60 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:17.271084 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e896c-e065-4e57-8387-4de059a56a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:17.292440 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-e01e896c-e065-4e57-8387-4de059a56a60 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:17.293852 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-e01e896c-e065-4e57-8387-4de059a56a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:17.302617 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 544/1089] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:20:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:20:17.354845 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e908a-ad89-4dda-adb7-2728cbc37c8d None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:17.355178 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e908a-ad89-4dda-adb7-2728cbc37c8d None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:17.355391 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e908a-ad89-4dda-adb7-2728cbc37c8d None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:17.356848 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 546/1090] 10.222.0.60 () {54 vars in 966 bytes} [Tue Jul 26 10:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:20:17.363695 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd6f55-9109-441a-bf8f-fdc587923c96 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:17.364126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd6f55-9109-441a-bf8f-fdc587923c96 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:17.364518 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd6f55-9109-441a-bf8f-fdc587923c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:17.390647 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-a0bd6f55-9109-441a-bf8f-fdc587923c96 None None] MFA Rules not processed for user `7f4adbb70e9f46f9a6a416329e8c0bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:17.392563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-a0bd6f55-9109-441a-bf8f-fdc587923c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:17.399544 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 545/1091] 10.222.0.60 () {58 vars in 1063 bytes} [Tue Jul 26 10:20:17 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:20:17.411089 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e908a-ad89-4dda-adb7-2728cbc37c8d None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:20:17.426421 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e908a-ad89-4dda-adb7-2728cbc37c8d None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:20:17.430037 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a2628-b2f8-493a-a29c-5695fd416d4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4adbb70e9f46f9a6a416329e8c0bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:20:17.430714 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a2628-b2f8-493a-a29c-5695fd416d4c service glance] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:17.430989 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a2628-b2f8-493a-a29c-5695fd416d4c service glance] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:17.431260 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a2628-b2f8-493a-a29c-5695fd416d4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:17.441536 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a2628-b2f8-493a-a29c-5695fd416d4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:20:17.443039 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a2628-b2f8-493a-a29c-5695fd416d4c service glance] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:20:17.454342 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 547/1092] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:20:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:20:19.868847 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee2a1a-b4da-432a-ae7b-73ea87194f76 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:19.869529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee2a1a-b4da-432a-ae7b-73ea87194f76 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:19.869529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee2a1a-b4da-432a-ae7b-73ea87194f76 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:19.871148 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 546/1093] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:20:19.879251 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d86b1b-ebb0-4a2f-a6ac-abfa274ac7f6 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:19.879871 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d86b1b-ebb0-4a2f-a6ac-abfa274ac7f6 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:19.880054 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d86b1b-ebb0-4a2f-a6ac-abfa274ac7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:19.906080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-39d86b1b-ebb0-4a2f-a6ac-abfa274ac7f6 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:19.907670 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-39d86b1b-ebb0-4a2f-a6ac-abfa274ac7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:19.915745 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 548/1094] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:20:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:20:19.940521 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee2a1a-b4da-432a-ae7b-73ea87194f76 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:20:19.955033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee2a1a-b4da-432a-ae7b-73ea87194f76 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:20:19.960453 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ef510-e411-4233-811d-e80f6fec1e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:20:19.961096 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ef510-e411-4233-811d-e80f6fec1e90 admin admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:19.961373 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ef510-e411-4233-811d-e80f6fec1e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:19.961643 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ef510-e411-4233-811d-e80f6fec1e90 admin admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:19.962347 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ef510-e411-4233-811d-e80f6fec1e90 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:20:19.964175 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: WARNING py.warnings [None req-112ef510-e411-4233-811d-e80f6fec1e90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:20:19.964175 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: warnings.warn(msg) Jul 26 10:20:19.964175 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: Jul 26 10:20:19.965298 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ef510-e411-4233-811d-e80f6fec1e90 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:20:19.985483 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 547/1095] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Jul 26 10:20:19 2022] GET /identity/v3/projects => generated 1606 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:20:22.277434 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a35a7-8143-49cf-a74c-d1ed08166475 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:22.278036 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a35a7-8143-49cf-a74c-d1ed08166475 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:22.278036 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a35a7-8143-49cf-a74c-d1ed08166475 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:22.279262 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 549/1096] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:20:22.286124 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6d820-af44-4822-a25b-cafa35e95eb3 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:22.286644 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6d820-af44-4822-a25b-cafa35e95eb3 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:22.286817 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6d820-af44-4822-a25b-cafa35e95eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:22.307132 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-12f6d820-af44-4822-a25b-cafa35e95eb3 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:22.308434 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-12f6d820-af44-4822-a25b-cafa35e95eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:22.316462 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 548/1097] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:20:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:20:22.363336 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a35a7-8143-49cf-a74c-d1ed08166475 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:20:22.379465 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a35a7-8143-49cf-a74c-d1ed08166475 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:20:22.385721 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fca5b-1a80-4bb7-9c77-b176e93839b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:20:22.386368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fca5b-1a80-4bb7-9c77-b176e93839b3 service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:22.386714 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fca5b-1a80-4bb7-9c77-b176e93839b3 service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:22.386987 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fca5b-1a80-4bb7-9c77-b176e93839b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:22.396321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fca5b-1a80-4bb7-9c77-b176e93839b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:20:22.398001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fca5b-1a80-4bb7-9c77-b176e93839b3 service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:20:22.408702 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 550/1098] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:20:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:20:24.958893 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cdc18-4b8f-4343-a5e2-7ff03d321e39 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:24.959495 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cdc18-4b8f-4343-a5e2-7ff03d321e39 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:24.959495 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cdc18-4b8f-4343-a5e2-7ff03d321e39 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:24.960795 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 549/1099] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:20:24.966900 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae0cf8-85ec-486f-905e-37035bd2db82 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:24.967481 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae0cf8-85ec-486f-905e-37035bd2db82 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:24.967481 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae0cf8-85ec-486f-905e-37035bd2db82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:24.988658 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-90ae0cf8-85ec-486f-905e-37035bd2db82 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:24.989887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-90ae0cf8-85ec-486f-905e-37035bd2db82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:24.999036 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 551/1100] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:20:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:20:25.038266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cdc18-4b8f-4343-a5e2-7ff03d321e39 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:20:25.051063 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cdc18-4b8f-4343-a5e2-7ff03d321e39 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:20:25.055330 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3af13-6583-46b9-9016-93199bfe6970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:20:25.056097 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3af13-6583-46b9-9016-93199bfe6970 service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:25.056472 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3af13-6583-46b9-9016-93199bfe6970 service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:25.056847 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3af13-6583-46b9-9016-93199bfe6970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:25.068267 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3af13-6583-46b9-9016-93199bfe6970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:20:25.069816 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3af13-6583-46b9-9016-93199bfe6970 service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:20:25.080974 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 550/1101] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:20:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:20:27.481740 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c03ab-e1d7-4503-a74b-1217cbf8e1ac None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:27.481740 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c03ab-e1d7-4503-a74b-1217cbf8e1ac None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:27.481740 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c03ab-e1d7-4503-a74b-1217cbf8e1ac None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:27.483094 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 552/1102] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:20:27.489177 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade829ad-1a61-4b00-8726-6f2d4ad1c596 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:27.489850 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade829ad-1a61-4b00-8726-6f2d4ad1c596 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:27.489850 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade829ad-1a61-4b00-8726-6f2d4ad1c596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:27.517594 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-ade829ad-1a61-4b00-8726-6f2d4ad1c596 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:27.518941 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-ade829ad-1a61-4b00-8726-6f2d4ad1c596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:27.528196 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 551/1103] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:20:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:20:27.571112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c03ab-e1d7-4503-a74b-1217cbf8e1ac None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:20:27.583011 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c03ab-e1d7-4503-a74b-1217cbf8e1ac None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:20:27.586925 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99d9b0-0f53-4b2f-9b11-7dc997cc4c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:20:27.587582 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99d9b0-0f53-4b2f-9b11-7dc997cc4c22 service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:27.587859 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99d9b0-0f53-4b2f-9b11-7dc997cc4c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:27.588125 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99d9b0-0f53-4b2f-9b11-7dc997cc4c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:27.599606 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99d9b0-0f53-4b2f-9b11-7dc997cc4c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:20:27.601104 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99d9b0-0f53-4b2f-9b11-7dc997cc4c22 service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:20:27.612480 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 553/1104] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:20:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:20:30.041061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b821b-9712-4df3-9b4a-72f35c9e1377 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:30.041765 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b821b-9712-4df3-9b4a-72f35c9e1377 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:30.041765 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b821b-9712-4df3-9b4a-72f35c9e1377 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:30.043255 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 552/1105] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:20:30.049620 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f744c1d-1d7e-49b8-b45b-6d9d7bde2d01 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:30.050262 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f744c1d-1d7e-49b8-b45b-6d9d7bde2d01 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:30.050262 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f744c1d-1d7e-49b8-b45b-6d9d7bde2d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:30.072813 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-3f744c1d-1d7e-49b8-b45b-6d9d7bde2d01 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:30.074050 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-3f744c1d-1d7e-49b8-b45b-6d9d7bde2d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:30.083524 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 554/1106] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:20:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:20:30.126352 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b821b-9712-4df3-9b4a-72f35c9e1377 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:20:30.139904 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b821b-9712-4df3-9b4a-72f35c9e1377 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:20:30.143923 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81815bc4-fdb6-4a85-a0de-175f983f677d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:20:30.144569 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81815bc4-fdb6-4a85-a0de-175f983f677d service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:30.147314 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81815bc4-fdb6-4a85-a0de-175f983f677d service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:30.147628 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81815bc4-fdb6-4a85-a0de-175f983f677d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:30.163225 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81815bc4-fdb6-4a85-a0de-175f983f677d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:20:30.164711 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81815bc4-fdb6-4a85-a0de-175f983f677d service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:20:30.175930 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 553/1107] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:20:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:20:32.788603 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a11cc-92fb-46b3-8c2d-c3d5df7d9400 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:32.789172 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a11cc-92fb-46b3-8c2d-c3d5df7d9400 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:32.789172 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a11cc-92fb-46b3-8c2d-c3d5df7d9400 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:32.790409 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 555/1108] 10.222.0.60 () {54 vars in 926 bytes} [Tue Jul 26 10:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:20:32.796020 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea35ffb-0ee0-4c25-b8c0-0bc96c9280bd None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:32.796755 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea35ffb-0ee0-4c25-b8c0-0bc96c9280bd None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:32.796755 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea35ffb-0ee0-4c25-b8c0-0bc96c9280bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:32.817689 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-0ea35ffb-0ee0-4c25-b8c0-0bc96c9280bd None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:32.818937 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-0ea35ffb-0ee0-4c25-b8c0-0bc96c9280bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:32.827502 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 554/1109] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Jul 26 10:20:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:20:32.869080 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a11cc-92fb-46b3-8c2d-c3d5df7d9400 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:20:32.881261 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a11cc-92fb-46b3-8c2d-c3d5df7d9400 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:20:32.885100 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f7b88-7f97-4115-8866-8618d8a4a0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:20:32.885728 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f7b88-7f97-4115-8866-8618d8a4a0fe service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:32.885999 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f7b88-7f97-4115-8866-8618d8a4a0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:32.886264 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f7b88-7f97-4115-8866-8618d8a4a0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:32.898968 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f7b88-7f97-4115-8866-8618d8a4a0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:20:32.901451 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f7b88-7f97-4115-8866-8618d8a4a0fe service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:20:32.915766 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 556/1110] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:20:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:20:42.812237 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=33 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:42.909094 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=33 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:22:03.866361 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb94a88-80a4-4f38-ac36-21a44e2a9dde None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:03.867320 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb94a88-80a4-4f38-ac36-21a44e2a9dde None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:03.867320 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb94a88-80a4-4f38-ac36-21a44e2a9dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:03.888255 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-1eb94a88-80a4-4f38-ac36-21a44e2a9dde None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:22:03.889486 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-1eb94a88-80a4-4f38-ac36-21a44e2a9dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:22:03.899046 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 555/1111] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:22:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:22:03.911833 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1101a76-9fbc-4cfa-a474-79fd7437d5ab None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:03.912413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1101a76-9fbc-4cfa-a474-79fd7437d5ab None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:03.912413 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1101a76-9fbc-4cfa-a474-79fd7437d5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:03.939046 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-e1101a76-9fbc-4cfa-a474-79fd7437d5ab None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:22:03.940255 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-e1101a76-9fbc-4cfa-a474-79fd7437d5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:22:03.949625 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 557/1112] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:22:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:22:03.955005 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb94a88-80a4-4f38-ac36-21a44e2a9dde None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:22:03.969427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb94a88-80a4-4f38-ac36-21a44e2a9dde None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:22:03.976513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4df695-03bf-4e59-9e8c-7b20929f29ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:22:03.977157 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4df695-03bf-4e59-9e8c-7b20929f29ea admin admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:03.977472 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4df695-03bf-4e59-9e8c-7b20929f29ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:03.977777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4df695-03bf-4e59-9e8c-7b20929f29ea admin admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:03.978535 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4df695-03bf-4e59-9e8c-7b20929f29ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:22:03.978847 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4df695-03bf-4e59-9e8c-7b20929f29ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:22:03.979876 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: WARNING py.warnings [None req-0d4df695-03bf-4e59-9e8c-7b20929f29ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:22:03.979876 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: warnings.warn(msg) Jul 26 10:22:03.979876 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: Jul 26 10:22:03.980788 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4df695-03bf-4e59-9e8c-7b20929f29ea admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:22:03.994149 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 556/1113] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Jul 26 10:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:22:04.003016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1101a76-9fbc-4cfa-a474-79fd7437d5ab None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:22:04.012686 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1101a76-9fbc-4cfa-a474-79fd7437d5ab None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:22:04.018389 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ede9e-37e7-450f-935a-12a2be9231d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:22:04.019356 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ede9e-37e7-450f-935a-12a2be9231d3 admin admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:04.019356 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ede9e-37e7-450f-935a-12a2be9231d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:04.019559 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ede9e-37e7-450f-935a-12a2be9231d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:04.020225 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ede9e-37e7-450f-935a-12a2be9231d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:22:04.021995 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: WARNING py.warnings [None req-1a5ede9e-37e7-450f-935a-12a2be9231d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:22:04.021995 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: warnings.warn(msg) Jul 26 10:22:04.021995 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: Jul 26 10:22:04.023234 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ede9e-37e7-450f-935a-12a2be9231d3 admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:22:04.055464 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 558/1114] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Jul 26 10:22:04 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:22:04.059900 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4df695-03bf-4e59-9e8c-7b20929f29ea admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:22:04.071901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4df695-03bf-4e59-9e8c-7b20929f29ea admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:22:04.135976 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf2e28-02f7-48b0-b922-e83ff2995d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:22:04.136623 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf2e28-02f7-48b0-b922-e83ff2995d45 admin admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:04.136868 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf2e28-02f7-48b0-b922-e83ff2995d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:04.137157 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf2e28-02f7-48b0-b922-e83ff2995d45 admin admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:04.138727 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf2e28-02f7-48b0-b922-e83ff2995d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:22:04.138863 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: WARNING py.warnings [None req-46bf2e28-02f7-48b0-b922-e83ff2995d45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:22:04.138863 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: warnings.warn(msg) Jul 26 10:22:04.138863 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: Jul 26 10:22:04.140189 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf2e28-02f7-48b0-b922-e83ff2995d45 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:22:04.165374 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 557/1115] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Jul 26 10:22:04 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:22:04.169679 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ede9e-37e7-450f-935a-12a2be9231d3 admin admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:22:04.180273 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ede9e-37e7-450f-935a-12a2be9231d3 admin admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:22:04.185528 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cf3f8-4ae5-49e5-a0d0-ee3a63cc84f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:22:04.186151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cf3f8-4ae5-49e5-a0d0-ee3a63cc84f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:04.186425 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cf3f8-4ae5-49e5-a0d0-ee3a63cc84f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:04.186729 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cf3f8-4ae5-49e5-a0d0-ee3a63cc84f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:04.187423 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cf3f8-4ae5-49e5-a0d0-ee3a63cc84f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:22:04.188463 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: WARNING py.warnings [None req-e70cf3f8-4ae5-49e5-a0d0-ee3a63cc84f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:22:04.188463 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: warnings.warn(msg) Jul 26 10:22:04.188463 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: Jul 26 10:22:04.189352 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cf3f8-4ae5-49e5-a0d0-ee3a63cc84f7 admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:22:04.202374 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 559/1116] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Jul 26 10:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:22:04.206731 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf2e28-02f7-48b0-b922-e83ff2995d45 admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:22:04.217133 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf2e28-02f7-48b0-b922-e83ff2995d45 admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:22:04.222327 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bff1ca-7a2f-4156-97a1-c326f018f9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:22:04.222980 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bff1ca-7a2f-4156-97a1-c326f018f9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:04.223270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bff1ca-7a2f-4156-97a1-c326f018f9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:04.223542 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bff1ca-7a2f-4156-97a1-c326f018f9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:04.224250 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bff1ca-7a2f-4156-97a1-c326f018f9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:22:04.225266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: WARNING py.warnings [None req-14bff1ca-7a2f-4156-97a1-c326f018f9f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:22:04.225266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: warnings.warn(msg) Jul 26 10:22:04.225266 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: Jul 26 10:22:04.226148 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bff1ca-7a2f-4156-97a1-c326f018f9f5 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:22:04.240966 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 558/1117] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Jul 26 10:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:22:04.245581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cf3f8-4ae5-49e5-a0d0-ee3a63cc84f7 admin admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:22:04.256094 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cf3f8-4ae5-49e5-a0d0-ee3a63cc84f7 admin admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:22:04.262074 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f7491-ab3e-4a5f-9198-3b1dda9c79b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:22:04.262795 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f7491-ab3e-4a5f-9198-3b1dda9c79b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:04.263067 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f7491-ab3e-4a5f-9198-3b1dda9c79b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:04.263335 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f7491-ab3e-4a5f-9198-3b1dda9c79b7 admin admin] PATH_INFO: `/v3/projects/00bc160974fc41129614b1df00deb853/users/82877a0405bc47f5b83775a1ebcafca6/roles/c483c855d04b4145a203e1f0eedf3c0c` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:04.282247 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f7491-ab3e-4a5f-9198-3b1dda9c79b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00bc160974fc41129614b1df00deb853, user_id=82877a0405bc47f5b83775a1ebcafca6, role_id=c483c855d04b4145a203e1f0eedf3c0c)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:22:04.283368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: WARNING py.warnings [None req-7d3f7491-ab3e-4a5f-9198-3b1dda9c79b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:22:04.283368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: warnings.warn(msg) Jul 26 10:22:04.283368 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: Jul 26 10:22:04.285316 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f7491-ab3e-4a5f-9198-3b1dda9c79b7 admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:22:04.299961 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 560/1118] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Jul 26 10:22:04 2022] PUT /identity/v3/projects/00bc160974fc41129614b1df00deb853/users/82877a0405bc47f5b83775a1ebcafca6/roles/c483c855d04b4145a203e1f0eedf3c0c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:22:04.312574 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748462b4-91d6-4339-b671-5d29608cb3bd None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:04.312885 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748462b4-91d6-4339-b671-5d29608cb3bd None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:04.313135 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748462b4-91d6-4339-b671-5d29608cb3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:04.342789 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-748462b4-91d6-4339-b671-5d29608cb3bd None None] MFA Rules not processed for user `82877a0405bc47f5b83775a1ebcafca6`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:22:04.344028 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-748462b4-91d6-4339-b671-5d29608cb3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:22:04.417342 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 559/1119] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:22:04 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:22:04.430635 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3779f-a4bd-4af2-81c8-c4c24b750bc6 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:04.430921 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3779f-a4bd-4af2-81c8-c4c24b750bc6 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:04.431302 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3779f-a4bd-4af2-81c8-c4c24b750bc6 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:04.432644 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 561/1120] 10.222.0.60 () {54 vars in 964 bytes} [Tue Jul 26 10:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:22:04.438872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858aa67b-da1a-421d-8eef-6b653c4c3e37 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:04.439140 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858aa67b-da1a-421d-8eef-6b653c4c3e37 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:04.440150 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858aa67b-da1a-421d-8eef-6b653c4c3e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:04.461285 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-858aa67b-da1a-421d-8eef-6b653c4c3e37 None None] MFA Rules not processed for user `6a2272bbc60f47fc929b1cc352533f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:22:04.462996 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-858aa67b-da1a-421d-8eef-6b653c4c3e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:22:04.509887 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:22:04.519184 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 560/1121] 10.222.0.60 () {58 vars in 1061 bytes} [Tue Jul 26 10:22:04 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:22:04.527235 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3779f-a4bd-4af2-81c8-c4c24b750bc6 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:22:04.539566 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3779f-a4bd-4af2-81c8-c4c24b750bc6 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:22:04.543839 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64e3e4-7603-476f-9bae-03d5a33fbed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2272bbc60f47fc929b1cc352533f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:22:04.544497 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64e3e4-7603-476f-9bae-03d5a33fbed6 service cinder] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:04.544779 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64e3e4-7603-476f-9bae-03d5a33fbed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:04.545047 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64e3e4-7603-476f-9bae-03d5a33fbed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:04.554289 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64e3e4-7603-476f-9bae-03d5a33fbed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:22:04.555837 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64e3e4-7603-476f-9bae-03d5a33fbed6 service cinder] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:22:04.565086 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 562/1122] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:22:04 2022] GET /identity/v3/auth/tokens => generated 2802 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:22:04.603955 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e54d49-f1a4-4711-bf3e-a59511e5f3cb None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:04.604243 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e54d49-f1a4-4711-bf3e-a59511e5f3cb None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:04.604547 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e54d49-f1a4-4711-bf3e-a59511e5f3cb None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:04.605875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 561/1123] 10.222.0.60 () {52 vars in 830 bytes} [Tue Jul 26 10:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:22:04.610983 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64e3e4-7603-476f-9bae-03d5a33fbed6 service cinder] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:22:04.680601 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64e3e4-7603-476f-9bae-03d5a33fbed6 service cinder] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:22:04.687487 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce11df-6be2-4f97-8a3a-e38225e38818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:22:04.688557 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce11df-6be2-4f97-8a3a-e38225e38818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:04.689012 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce11df-6be2-4f97-8a3a-e38225e38818 admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:04.689501 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce11df-6be2-4f97-8a3a-e38225e38818 admin admin] PATH_INFO: `/v3/users/82877a0405bc47f5b83775a1ebcafca6` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:04.691597 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce11df-6be2-4f97-8a3a-e38225e38818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82877a0405bc47f5b83775a1ebcafca6)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:22:04.693232 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: WARNING py.warnings [None req-59ce11df-6be2-4f97-8a3a-e38225e38818 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:22:04.693232 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: warnings.warn(msg) Jul 26 10:22:04.693232 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: Jul 26 10:22:04.695287 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce11df-6be2-4f97-8a3a-e38225e38818 admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:22:04.763957 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-59ce11df-6be2-4f97-8a3a-e38225e38818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82877a0405bc47f5b83775a1ebcafca6'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:22:04.764595 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-59ce11df-6be2-4f97-8a3a-e38225e38818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82877a0405bc47f5b83775a1ebcafca6'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:22:04.776814 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-59ce11df-6be2-4f97-8a3a-e38225e38818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82877a0405bc47f5b83775a1ebcafca6'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:22:04.777575 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-59ce11df-6be2-4f97-8a3a-e38225e38818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82877a0405bc47f5b83775a1ebcafca6'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:22:04.797300 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-59ce11df-6be2-4f97-8a3a-e38225e38818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82877a0405bc47f5b83775a1ebcafca6'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:22:04.814527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 563/1124] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Jul 26 10:22:04 2022] DELETE /identity/v3/users/82877a0405bc47f5b83775a1ebcafca6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:22:04.820654 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c01380-ecbd-4d77-84ba-3a45d448661c None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:04.820970 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c01380-ecbd-4d77-84ba-3a45d448661c None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:04.821247 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c01380-ecbd-4d77-84ba-3a45d448661c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:04.841379 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-b7c01380-ecbd-4d77-84ba-3a45d448661c None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:22:04.842626 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-b7c01380-ecbd-4d77-84ba-3a45d448661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:22:04.907404 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 562/1125] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:22:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:22:04.917510 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce11df-6be2-4f97-8a3a-e38225e38818 admin admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:22:04.919168 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-59ce11df-6be2-4f97-8a3a-e38225e38818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:22:04.924926 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:22:04.989735 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce11df-6be2-4f97-8a3a-e38225e38818 admin admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:22:04.993897 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b03ed7-7723-4b3f-a3e6-7328967a7b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:22:04.994540 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b03ed7-7723-4b3f-a3e6-7328967a7b29 service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:04.994821 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b03ed7-7723-4b3f-a3e6-7328967a7b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:04.995091 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b03ed7-7723-4b3f-a3e6-7328967a7b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:05.004581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b03ed7-7723-4b3f-a3e6-7328967a7b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:22:05.006025 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b03ed7-7723-4b3f-a3e6-7328967a7b29 service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:22:05.016135 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 564/1126] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:22:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:22:05.438283 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c01380-ecbd-4d77-84ba-3a45d448661c None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:22:05.441015 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-b7c01380-ecbd-4d77-84ba-3a45d448661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:22:05.455655 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c01380-ecbd-4d77-84ba-3a45d448661c None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:22:05.461529 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:22:05.462056 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:22:05.462358 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:22:05.462674 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9 admin admin] PATH_INFO: `/v3/projects/00bc160974fc41129614b1df00deb853` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:22:05.463888 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00bc160974fc41129614b1df00deb853)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:22:05.464976 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: WARNING py.warnings [None req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:22:05.464976 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: warnings.warn(msg) Jul 26 10:22:05.464976 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: Jul 26 10:22:05.466153 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:22:05.533292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00bc160974fc41129614b1df00deb853', 'request_id': 'req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:22:05.549615 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00bc160974fc41129614b1df00deb853', 'request_id': 'req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:22:05.560183 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00bc160974fc41129614b1df00deb853', 'request_id': 'req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:22:05.572126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9 admin admin] The token cache is being invalidate because project 00bc160974fc41129614b1df00deb853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 10:22:05.572403 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:22:05.573067 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-0d5a7405-dc29-40c7-9dd7-ad6a713719b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:22:05.574904 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 563/1127] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Jul 26 10:22:05 2022] DELETE /identity/v3/projects/00bc160974fc41129614b1df00deb853 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:22:15.011736 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=25 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:22:15.568778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:23:27.119471 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86e7b2-d19e-43f6-a46a-0999134034c5 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:27.120123 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86e7b2-d19e-43f6-a46a-0999134034c5 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:27.120123 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86e7b2-d19e-43f6-a46a-0999134034c5 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:27.122205 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 565/1128] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:23:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:23:27.127895 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f127533-7bcf-4ce6-9419-4a43fd4949ec None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:27.128361 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f127533-7bcf-4ce6-9419-4a43fd4949ec None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:27.128522 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f127533-7bcf-4ce6-9419-4a43fd4949ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:27.214237 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-7f127533-7bcf-4ce6-9419-4a43fd4949ec None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:27.215999 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-7f127533-7bcf-4ce6-9419-4a43fd4949ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:27.341918 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 564/1129] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:23:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:27.503996 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86e7b2-d19e-43f6-a46a-0999134034c5 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:27.506960 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-ff86e7b2-d19e-43f6-a46a-0999134034c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:27.616183 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86e7b2-d19e-43f6-a46a-0999134034c5 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:27.622612 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93b278-e962-466f-9157-1cb0de023926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:27.623318 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93b278-e962-466f-9157-1cb0de023926 service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:27.623597 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93b278-e962-466f-9157-1cb0de023926 service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:27.623845 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93b278-e962-466f-9157-1cb0de023926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:27.632801 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93b278-e962-466f-9157-1cb0de023926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:27.634454 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93b278-e962-466f-9157-1cb0de023926 service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:27.644170 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 566/1130] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:23:28.480879 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a9889-ac5b-47b9-bdd8-800220c780fb None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:28.481489 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a9889-ac5b-47b9-bdd8-800220c780fb None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:28.481489 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a9889-ac5b-47b9-bdd8-800220c780fb None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:28.483035 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 565/1131] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:23:28.488923 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e17bf5-509b-463f-9389-835559d8de03 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:28.489554 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e17bf5-509b-463f-9389-835559d8de03 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:28.489554 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e17bf5-509b-463f-9389-835559d8de03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:28.517276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-c0e17bf5-509b-463f-9389-835559d8de03 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:28.518550 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-c0e17bf5-509b-463f-9389-835559d8de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:28.528216 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 567/1132] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:23:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:28.686528 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a9889-ac5b-47b9-bdd8-800220c780fb None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:28.702563 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a9889-ac5b-47b9-bdd8-800220c780fb None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:28.708008 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a504f4-a304-4ca3-ae7c-4216f9f04039 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:28.708639 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a504f4-a304-4ca3-ae7c-4216f9f04039 service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:28.708959 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a504f4-a304-4ca3-ae7c-4216f9f04039 service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:28.709224 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a504f4-a304-4ca3-ae7c-4216f9f04039 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:28.718335 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a504f4-a304-4ca3-ae7c-4216f9f04039 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:28.719975 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a504f4-a304-4ca3-ae7c-4216f9f04039 service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:28.729834 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 566/1133] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:23:33.308337 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96e0e7-284f-441b-b0f6-548308d57948 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:33.308909 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96e0e7-284f-441b-b0f6-548308d57948 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:33.308909 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96e0e7-284f-441b-b0f6-548308d57948 None None] PATH_INFO: `/v3` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:33.310118 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 568/1134] 10.222.0.52 () {54 vars in 925 bytes} [Tue Jul 26 10:23:33 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:23:33.319723 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f321268-a277-4807-a9c3-e9712ff1a2dd None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:33.320192 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f321268-a277-4807-a9c3-e9712ff1a2dd None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:33.320285 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f321268-a277-4807-a9c3-e9712ff1a2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:33.352875 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-0f321268-a277-4807-a9c3-e9712ff1a2dd None None] MFA Rules not processed for user `32a61a4fe5c74444af1afdbeaf9be512`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:33.354089 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-0f321268-a277-4807-a9c3-e9712ff1a2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:33.414232 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=100 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:23:33.424927 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 567/1135] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Jul 26 10:23:33 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:37.610511 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159c11d-d7ec-4729-858f-a476715fe5a0 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:37.611252 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159c11d-d7ec-4729-858f-a476715fe5a0 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:37.611252 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159c11d-d7ec-4729-858f-a476715fe5a0 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:37.613131 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 569/1136] 10.222.0.60 () {54 vars in 961 bytes} [Tue Jul 26 10:23:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:23:37.618652 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde73b6-ad6f-40f2-8ddf-e52ada15bd04 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:37.619123 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde73b6-ad6f-40f2-8ddf-e52ada15bd04 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:37.619231 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde73b6-ad6f-40f2-8ddf-e52ada15bd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:37.641233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-4bde73b6-ad6f-40f2-8ddf-e52ada15bd04 None None] MFA Rules not processed for user `32a61a4fe5c74444af1afdbeaf9be512`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:37.642463 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-4bde73b6-ad6f-40f2-8ddf-e52ada15bd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:37.653962 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 568/1137] 10.222.0.60 () {58 vars in 1058 bytes} [Tue Jul 26 10:23:37 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:37.663909 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159c11d-d7ec-4729-858f-a476715fe5a0 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:37.681644 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159c11d-d7ec-4729-858f-a476715fe5a0 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:37.687739 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705c95b-3d71-417b-b22b-ba30de02d08a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a61a4fe5c74444af1afdbeaf9be512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:37.688358 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705c95b-3d71-417b-b22b-ba30de02d08a service placement] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:37.688636 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705c95b-3d71-417b-b22b-ba30de02d08a service placement] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:37.688907 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705c95b-3d71-417b-b22b-ba30de02d08a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:37.699099 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705c95b-3d71-417b-b22b-ba30de02d08a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:37.701019 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705c95b-3d71-417b-b22b-ba30de02d08a service placement] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:37.713425 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 570/1138] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:37 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:23:40.004922 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058c9d5-360a-4496-afcf-b06bc2da49eb None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:40.005523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058c9d5-360a-4496-afcf-b06bc2da49eb None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:40.005523 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058c9d5-360a-4496-afcf-b06bc2da49eb None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:40.006876 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 569/1139] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:23:40.013052 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c458384-9ce3-49de-a2b1-4d710763f580 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:40.013505 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c458384-9ce3-49de-a2b1-4d710763f580 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:40.013614 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c458384-9ce3-49de-a2b1-4d710763f580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:40.040581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-2c458384-9ce3-49de-a2b1-4d710763f580 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:40.041918 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-2c458384-9ce3-49de-a2b1-4d710763f580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:40.050832 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 571/1140] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:23:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:40.215426 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058c9d5-360a-4496-afcf-b06bc2da49eb None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:40.230323 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058c9d5-360a-4496-afcf-b06bc2da49eb None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:40.235653 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b8c7b-61cf-422c-aa60-c73c0fb72a5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:40.236270 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b8c7b-61cf-422c-aa60-c73c0fb72a5a service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:40.236549 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b8c7b-61cf-422c-aa60-c73c0fb72a5a service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:40.236820 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b8c7b-61cf-422c-aa60-c73c0fb72a5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:40.247195 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b8c7b-61cf-422c-aa60-c73c0fb72a5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:40.248999 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b8c7b-61cf-422c-aa60-c73c0fb72a5a service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:40.259101 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 570/1141] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:23:41.076937 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6395b1-7140-4b8c-b238-88d31a8cdef0 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:41.077828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6395b1-7140-4b8c-b238-88d31a8cdef0 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:41.077828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6395b1-7140-4b8c-b238-88d31a8cdef0 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:41.080095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 572/1142] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:23:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:23:41.088191 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c554b-5e95-4f5f-9729-299079ff5a7c None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:41.088920 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c554b-5e95-4f5f-9729-299079ff5a7c None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:41.089080 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c554b-5e95-4f5f-9729-299079ff5a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:41.113349 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-518c554b-5e95-4f5f-9729-299079ff5a7c None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:41.114648 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-518c554b-5e95-4f5f-9729-299079ff5a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:41.125074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 571/1143] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:23:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:41.288165 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6395b1-7140-4b8c-b238-88d31a8cdef0 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:41.306646 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6395b1-7140-4b8c-b238-88d31a8cdef0 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:41.312144 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fda781-b8b4-428e-99d1-e3fc2b5f2bfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:41.312751 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fda781-b8b4-428e-99d1-e3fc2b5f2bfe service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:41.313026 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fda781-b8b4-428e-99d1-e3fc2b5f2bfe service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:41.313294 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fda781-b8b4-428e-99d1-e3fc2b5f2bfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:41.321622 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fda781-b8b4-428e-99d1-e3fc2b5f2bfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:41.323280 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fda781-b8b4-428e-99d1-e3fc2b5f2bfe service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:41.333444 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 573/1144] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:23:45.450727 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fdf54-e31d-4c55-8f96-620d65a7328f None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:45.451312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fdf54-e31d-4c55-8f96-620d65a7328f None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:45.451312 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fdf54-e31d-4c55-8f96-620d65a7328f None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:45.452660 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 572/1145] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:23:45.459496 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923063c-4621-4c76-a2df-519fa9c5ae5e None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:45.460514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923063c-4621-4c76-a2df-519fa9c5ae5e None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:45.460514 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923063c-4621-4c76-a2df-519fa9c5ae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:45.484576 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-a923063c-4621-4c76-a2df-519fa9c5ae5e None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:45.485798 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-a923063c-4621-4c76-a2df-519fa9c5ae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:45.493983 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 574/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:23:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:45.535423 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fdf54-e31d-4c55-8f96-620d65a7328f None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:45.537501 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-890fdf54-e31d-4c55-8f96-620d65a7328f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:45.602047 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fdf54-e31d-4c55-8f96-620d65a7328f None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:45.606262 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afa9c2-ac55-4018-b5e2-08e961c7d43b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:45.606916 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afa9c2-ac55-4018-b5e2-08e961c7d43b service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:45.607188 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afa9c2-ac55-4018-b5e2-08e961c7d43b service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:45.607452 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afa9c2-ac55-4018-b5e2-08e961c7d43b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:45.619688 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afa9c2-ac55-4018-b5e2-08e961c7d43b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:45.621137 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afa9c2-ac55-4018-b5e2-08e961c7d43b service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:45.631199 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 573/1147] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:23:47.814719 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781a129-9f53-4e04-90aa-896381d8ac8f None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:47.815343 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781a129-9f53-4e04-90aa-896381d8ac8f None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:47.815343 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781a129-9f53-4e04-90aa-896381d8ac8f None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:47.816699 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 575/1148] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:23:47.825151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eb6a8-2830-4762-85d3-275e14325933 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:47.825910 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eb6a8-2830-4762-85d3-275e14325933 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:47.826087 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eb6a8-2830-4762-85d3-275e14325933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:47.854578 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-864eb6a8-2830-4762-85d3-275e14325933 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:47.855842 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-864eb6a8-2830-4762-85d3-275e14325933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:47.865387 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 574/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:23:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:47.914044 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781a129-9f53-4e04-90aa-896381d8ac8f None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:47.915884 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-d781a129-9f53-4e04-90aa-896381d8ac8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:47.930069 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781a129-9f53-4e04-90aa-896381d8ac8f None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:47.933701 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fee4a-0c88-47f1-b86e-2020ca041fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:47.934342 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fee4a-0c88-47f1-b86e-2020ca041fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:47.934653 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fee4a-0c88-47f1-b86e-2020ca041fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:47.934924 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fee4a-0c88-47f1-b86e-2020ca041fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:47.948202 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fee4a-0c88-47f1-b86e-2020ca041fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:47.950207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fee4a-0c88-47f1-b86e-2020ca041fb0 service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:47.961188 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 576/1150] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:23:51.766238 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd0e82-8ec4-4659-9eba-cad1a50a141e None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:51.766853 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd0e82-8ec4-4659-9eba-cad1a50a141e None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:51.766853 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd0e82-8ec4-4659-9eba-cad1a50a141e None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:51.768225 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 575/1151] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:23:51.773700 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc84c-13b2-46e0-8e93-55a39c655901 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:51.774189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc84c-13b2-46e0-8e93-55a39c655901 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:51.774189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc84c-13b2-46e0-8e93-55a39c655901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:51.794921 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-263dc84c-13b2-46e0-8e93-55a39c655901 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:51.796123 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-263dc84c-13b2-46e0-8e93-55a39c655901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:51.805306 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 577/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:23:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:52.076623 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd0e82-8ec4-4659-9eba-cad1a50a141e None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:52.079272 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-4ffd0e82-8ec4-4659-9eba-cad1a50a141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:52.144583 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd0e82-8ec4-4659-9eba-cad1a50a141e None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:52.149121 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c2038-e98e-459e-b197-335630c3c7c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2272bbc60f47fc929b1cc352533f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:52.149766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c2038-e98e-459e-b197-335630c3c7c2 service cinder] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:52.150020 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c2038-e98e-459e-b197-335630c3c7c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:52.150319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c2038-e98e-459e-b197-335630c3c7c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:52.160443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c2038-e98e-459e-b197-335630c3c7c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:52.161911 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c2038-e98e-459e-b197-335630c3c7c2 service cinder] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:52.172300 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 576/1153] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:23:54.407263 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a9b82-91d1-47ed-8cf5-22558d37ab7c None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:54.407820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a9b82-91d1-47ed-8cf5-22558d37ab7c None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:54.407820 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a9b82-91d1-47ed-8cf5-22558d37ab7c None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:54.409198 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 578/1154] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:23:54.415766 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87a44a-9610-4e0f-a663-8bfad77f0e99 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:54.416460 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87a44a-9610-4e0f-a663-8bfad77f0e99 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:54.416581 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87a44a-9610-4e0f-a663-8bfad77f0e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:54.447167 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-0b87a44a-9610-4e0f-a663-8bfad77f0e99 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:54.448445 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-0b87a44a-9610-4e0f-a663-8bfad77f0e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:54.456353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 577/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:23:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:54.754678 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a9b82-91d1-47ed-8cf5-22558d37ab7c None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:54.757590 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-a96a9b82-91d1-47ed-8cf5-22558d37ab7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:54.776589 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a9b82-91d1-47ed-8cf5-22558d37ab7c None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:54.780781 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810b4ef-d0e9-4b04-a223-4521ac7ab65c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2272bbc60f47fc929b1cc352533f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:54.781402 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810b4ef-d0e9-4b04-a223-4521ac7ab65c service cinder] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:54.781684 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810b4ef-d0e9-4b04-a223-4521ac7ab65c service cinder] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:54.781959 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810b4ef-d0e9-4b04-a223-4521ac7ab65c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:54.791454 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810b4ef-d0e9-4b04-a223-4521ac7ab65c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:54.792896 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810b4ef-d0e9-4b04-a223-4521ac7ab65c service cinder] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:54.802441 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 579/1156] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:24:04.441926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=70 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:24:04.798401 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=75 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:14.389281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ba996-dd56-4dce-87c3-73618731a9cf None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.389945 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ba996-dd56-4dce-87c3-73618731a9cf None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.389945 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ba996-dd56-4dce-87c3-73618731a9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.411494 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-ca2ba996-dd56-4dce-87c3-73618731a9cf None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:14.412722 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-ca2ba996-dd56-4dce-87c3-73618731a9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:14.421335 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 578/1157] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:25:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:14.425523 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae631334-5bd2-4330-8355-e5ca40c4f1f8 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.426085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae631334-5bd2-4330-8355-e5ca40c4f1f8 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.426085 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae631334-5bd2-4330-8355-e5ca40c4f1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.429637 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c871fbd-efde-41a5-8575-20ea910404f2 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.429926 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c871fbd-efde-41a5-8575-20ea910404f2 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.430198 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c871fbd-efde-41a5-8575-20ea910404f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.447237 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-ae631334-5bd2-4330-8355-e5ca40c4f1f8 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:14.448491 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-ae631334-5bd2-4330-8355-e5ca40c4f1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:14.452233 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-4c871fbd-efde-41a5-8575-20ea910404f2 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:14.453510 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-4c871fbd-efde-41a5-8575-20ea910404f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:14.456620 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 580/1158] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:25:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:14.462349 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 579/1159] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:25:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:14.465246 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f75c3-0e12-41c5-8f04-2953969fb237 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.465536 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f75c3-0e12-41c5-8f04-2953969fb237 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.465811 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f75c3-0e12-41c5-8f04-2953969fb237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.467318 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c871fbd-efde-41a5-8575-20ea910404f2 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:14.477099 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c871fbd-efde-41a5-8575-20ea910404f2 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:14.482043 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16850bcb-9c6f-4d49-b706-22928f4086e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:14.482759 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16850bcb-9c6f-4d49-b706-22928f4086e8 admin admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.483036 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16850bcb-9c6f-4d49-b706-22928f4086e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.483485 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16850bcb-9c6f-4d49-b706-22928f4086e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.484216 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16850bcb-9c6f-4d49-b706-22928f4086e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:25:14.484542 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16850bcb-9c6f-4d49-b706-22928f4086e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:14.486179 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16850bcb-9c6f-4d49-b706-22928f4086e8 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:14.486388 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-3e2f75c3-0e12-41c5-8f04-2953969fb237 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:14.487655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-3e2f75c3-0e12-41c5-8f04-2953969fb237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:14.496449 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 581/1160] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:25:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:14.500124 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 580/1161] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Jul 26 10:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:25:14.502095 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f75c3-0e12-41c5-8f04-2953969fb237 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:14.509006 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16850bcb-9c6f-4d49-b706-22928f4086e8 admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:14.512373 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f75c3-0e12-41c5-8f04-2953969fb237 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:14.517202 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca0de3-3f57-42f8-8e51-ea831ba8b53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:14.517846 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca0de3-3f57-42f8-8e51-ea831ba8b53f admin admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.518135 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca0de3-3f57-42f8-8e51-ea831ba8b53f admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.518454 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca0de3-3f57-42f8-8e51-ea831ba8b53f admin admin] PATH_INFO: `/v3/domains` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.519165 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca0de3-3f57-42f8-8e51-ea831ba8b53f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:25:14.519467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca0de3-3f57-42f8-8e51-ea831ba8b53f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:14.519985 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16850bcb-9c6f-4d49-b706-22928f4086e8 admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:14.520518 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: WARNING py.warnings [None req-7eca0de3-3f57-42f8-8e51-ea831ba8b53f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:25:14.520518 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: warnings.warn(msg) Jul 26 10:25:14.520518 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: Jul 26 10:25:14.521403 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca0de3-3f57-42f8-8e51-ea831ba8b53f admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:14.525398 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b82bd-9ac9-4d3d-bf95-18ef28095640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:14.526242 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b82bd-9ac9-4d3d-bf95-18ef28095640 admin admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.526592 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b82bd-9ac9-4d3d-bf95-18ef28095640 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.526863 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b82bd-9ac9-4d3d-bf95-18ef28095640 admin admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.527545 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b82bd-9ac9-4d3d-bf95-18ef28095640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:14.528581 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: WARNING py.warnings [None req-ed4b82bd-9ac9-4d3d-bf95-18ef28095640 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:25:14.528581 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: warnings.warn(msg) Jul 26 10:25:14.528581 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: Jul 26 10:25:14.529784 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b82bd-9ac9-4d3d-bf95-18ef28095640 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:14.534755 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 582/1162] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Jul 26 10:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:25:14.542910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca0de3-3f57-42f8-8e51-ea831ba8b53f admin admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:14.553880 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca0de3-3f57-42f8-8e51-ea831ba8b53f admin admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:14.559240 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa393dc1-1b35-4136-989c-125fa64a2a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:14.559917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa393dc1-1b35-4136-989c-125fa64a2a2b admin admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.560208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa393dc1-1b35-4136-989c-125fa64a2a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.560449 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa393dc1-1b35-4136-989c-125fa64a2a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.561129 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa393dc1-1b35-4136-989c-125fa64a2a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:14.563157 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa393dc1-1b35-4136-989c-125fa64a2a2b admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:14.610825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 583/1163] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Jul 26 10:25:14 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:25:14.615406 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa393dc1-1b35-4136-989c-125fa64a2a2b admin admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:14.698419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa393dc1-1b35-4136-989c-125fa64a2a2b admin admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:14.706983 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb60b1-3be0-40ee-af46-263577195a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:14.707621 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb60b1-3be0-40ee-af46-263577195a55 admin admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.707893 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb60b1-3be0-40ee-af46-263577195a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.708160 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb60b1-3be0-40ee-af46-263577195a55 admin admin] PATH_INFO: `/v3/users` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.708859 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb60b1-3be0-40ee-af46-263577195a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:14.710120 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: WARNING py.warnings [None req-40fb60b1-3be0-40ee-af46-263577195a55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:25:14.710120 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: warnings.warn(msg) Jul 26 10:25:14.710120 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: Jul 26 10:25:14.710472 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 581/1164] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Jul 26 10:25:14 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:25:14.711146 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb60b1-3be0-40ee-af46-263577195a55 admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:14.714416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b82bd-9ac9-4d3d-bf95-18ef28095640 admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:14.735684 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 584/1165] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Jul 26 10:25:14 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:25:14.739972 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb60b1-3be0-40ee-af46-263577195a55 admin admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:14.750841 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb60b1-3be0-40ee-af46-263577195a55 admin admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:14.780379 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b82bd-9ac9-4d3d-bf95-18ef28095640 admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:14.786165 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446038a-c6d0-4092-9c71-eb693fae902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:14.786860 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446038a-c6d0-4092-9c71-eb693fae902d admin admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.787108 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446038a-c6d0-4092-9c71-eb693fae902d admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.787403 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446038a-c6d0-4092-9c71-eb693fae902d admin admin] PATH_INFO: `/v3/users` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.788072 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446038a-c6d0-4092-9c71-eb693fae902d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:14.790001 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446038a-c6d0-4092-9c71-eb693fae902d admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:14.808118 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77322c07-cca4-4d50-bc8e-e6c87add21b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:14.808858 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77322c07-cca4-4d50-bc8e-e6c87add21b6 admin admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.809126 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77322c07-cca4-4d50-bc8e-e6c87add21b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.809434 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77322c07-cca4-4d50-bc8e-e6c87add21b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.810159 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77322c07-cca4-4d50-bc8e-e6c87add21b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:14.811801 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77322c07-cca4-4d50-bc8e-e6c87add21b6 admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:14.813518 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 582/1166] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Jul 26 10:25:14 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:25:14.817707 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446038a-c6d0-4092-9c71-eb693fae902d admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:14.823048 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 585/1167] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:25:14.827145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77322c07-cca4-4d50-bc8e-e6c87add21b6 admin admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:14.828443 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446038a-c6d0-4092-9c71-eb693fae902d admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:14.833857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d374d53-a0a8-43a5-8b18-6d4205db7193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:14.834525 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d374d53-a0a8-43a5-8b18-6d4205db7193 admin admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.834803 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d374d53-a0a8-43a5-8b18-6d4205db7193 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.835070 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d374d53-a0a8-43a5-8b18-6d4205db7193 admin admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.835771 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d374d53-a0a8-43a5-8b18-6d4205db7193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:14.837383 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d374d53-a0a8-43a5-8b18-6d4205db7193 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:14.837711 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77322c07-cca4-4d50-bc8e-e6c87add21b6 admin admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:14.842677 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003c5e9-9bcf-4ec1-9430-0597aae4e793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:14.843304 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003c5e9-9bcf-4ec1-9430-0597aae4e793 admin admin] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.843581 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003c5e9-9bcf-4ec1-9430-0597aae4e793 admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.843887 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003c5e9-9bcf-4ec1-9430-0597aae4e793 admin admin] PATH_INFO: `/v3/roles` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.844577 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003c5e9-9bcf-4ec1-9430-0597aae4e793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:14.846171 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003c5e9-9bcf-4ec1-9430-0597aae4e793 admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:14.848456 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 583/1168] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 10:25:14.852481 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d374d53-a0a8-43a5-8b18-6d4205db7193 admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:14.863828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 586/1169] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 10:25:14.864032 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d374d53-a0a8-43a5-8b18-6d4205db7193 admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:14.864842 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003c5e9-9bcf-4ec1-9430-0597aae4e793 admin admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:14.868509 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159dc33-76b0-4a60-ad1f-55ebad7410ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:14.869301 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159dc33-76b0-4a60-ad1f-55ebad7410ce admin admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.869575 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159dc33-76b0-4a60-ad1f-55ebad7410ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.869838 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159dc33-76b0-4a60-ad1f-55ebad7410ce admin admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.870557 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159dc33-76b0-4a60-ad1f-55ebad7410ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:14.872204 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159dc33-76b0-4a60-ad1f-55ebad7410ce admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:14.874830 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003c5e9-9bcf-4ec1-9430-0597aae4e793 admin admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:14.879423 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e518d4-e674-4c49-933a-a525284976e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:14.880162 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e518d4-e674-4c49-933a-a525284976e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.880344 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e518d4-e674-4c49-933a-a525284976e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.880623 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e518d4-e674-4c49-933a-a525284976e7 admin admin] PATH_INFO: `/v3/projects/5773f10f8fb74cd7a3dd2d08398256a3/users/eb539e1e781a4dd998878d3c65ce37a7/roles/c483c855d04b4145a203e1f0eedf3c0c` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.883471 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 584/1170] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:25:14.887809 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159dc33-76b0-4a60-ad1f-55ebad7410ce admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:14.897341 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159dc33-76b0-4a60-ad1f-55ebad7410ce admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:14.899079 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e518d4-e674-4c49-933a-a525284976e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5773f10f8fb74cd7a3dd2d08398256a3, user_id=eb539e1e781a4dd998878d3c65ce37a7, role_id=c483c855d04b4145a203e1f0eedf3c0c)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:14.901758 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e518d4-e674-4c49-933a-a525284976e7 admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:14.902360 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ae057-cf50-4994-bcb2-8e539362cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:14.903163 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ae057-cf50-4994-bcb2-8e539362cf5a admin admin] REQUEST_METHOD: `PUT` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.903439 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ae057-cf50-4994-bcb2-8e539362cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.903702 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ae057-cf50-4994-bcb2-8e539362cf5a admin admin] PATH_INFO: `/v3/projects/d7eb7bb935af41458c5be5a6eee53325/users/21d4b60c39614760b28eadcb4d2a3fe0/roles/c483c855d04b4145a203e1f0eedf3c0c` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.904129 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:14.916539 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 587/1171] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Jul 26 10:25:14 2022] PUT /identity/v3/projects/5773f10f8fb74cd7a3dd2d08398256a3/users/eb539e1e781a4dd998878d3c65ce37a7/roles/c483c855d04b4145a203e1f0eedf3c0c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 10:25:14.920122 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ae057-cf50-4994-bcb2-8e539362cf5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7eb7bb935af41458c5be5a6eee53325, user_id=21d4b60c39614760b28eadcb4d2a3fe0, role_id=c483c855d04b4145a203e1f0eedf3c0c)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:14.921170 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: WARNING py.warnings [None req-9d4ae057-cf50-4994-bcb2-8e539362cf5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:25:14.921170 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: warnings.warn(msg) Jul 26 10:25:14.921170 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: Jul 26 10:25:14.921715 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad74827-0a5f-4bea-bfea-d229fbc6ecce None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.922001 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad74827-0a5f-4bea-bfea-d229fbc6ecce None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.922281 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad74827-0a5f-4bea-bfea-d229fbc6ecce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.923098 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ae057-cf50-4994-bcb2-8e539362cf5a admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:14.936195 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 585/1172] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Jul 26 10:25:14 2022] PUT /identity/v3/projects/d7eb7bb935af41458c5be5a6eee53325/users/21d4b60c39614760b28eadcb4d2a3fe0/roles/c483c855d04b4145a203e1f0eedf3c0c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:25:14.940716 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-6ad74827-0a5f-4bea-bfea-d229fbc6ecce None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:14.941412 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91656dab-834d-4206-be03-805a15717a44 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:14.941788 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91656dab-834d-4206-be03-805a15717a44 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:14.941904 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-6ad74827-0a5f-4bea-bfea-d229fbc6ecce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:14.942063 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91656dab-834d-4206-be03-805a15717a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:14.961061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-91656dab-834d-4206-be03-805a15717a44 None None] MFA Rules not processed for user `a7aff02dbe9d4c34ad6d286018218135`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:14.962202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-91656dab-834d-4206-be03-805a15717a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:15.002409 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 588/1173] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:25:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:25:15.012582 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:15.013258 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad74827-0a5f-4bea-bfea-d229fbc6ecce None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:15.034400 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 586/1174] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:25:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:25:15.044676 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91656dab-834d-4206-be03-805a15717a44 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:15.076256 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad74827-0a5f-4bea-bfea-d229fbc6ecce None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:15.080148 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2d96c-69e0-42d8-bf15-364fc8e7e8c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:15.080801 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2d96c-69e0-42d8-bf15-364fc8e7e8c4 service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:15.081076 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2d96c-69e0-42d8-bf15-364fc8e7e8c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:15.081330 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2d96c-69e0-42d8-bf15-364fc8e7e8c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:15.090780 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2d96c-69e0-42d8-bf15-364fc8e7e8c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:15.092233 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2d96c-69e0-42d8-bf15-364fc8e7e8c4 service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:15.101341 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91656dab-834d-4206-be03-805a15717a44 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:15.102101 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 589/1175] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:25:15.105172 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c3aa0-3e34-4be4-b0b5-334634171735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:15.105947 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c3aa0-3e34-4be4-b0b5-334634171735 service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:15.106227 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c3aa0-3e34-4be4-b0b5-334634171735 service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:15.106541 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c3aa0-3e34-4be4-b0b5-334634171735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:15.116292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c3aa0-3e34-4be4-b0b5-334634171735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:15.117767 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c3aa0-3e34-4be4-b0b5-334634171735 service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:15.128117 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 587/1176] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:25:20.038781 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447d838-d13e-42e7-82fa-cce64245e857 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:20.039427 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447d838-d13e-42e7-82fa-cce64245e857 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:20.039427 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447d838-d13e-42e7-82fa-cce64245e857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:20.082563 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-b447d838-d13e-42e7-82fa-cce64245e857 None None] MFA Rules not processed for user `eb539e1e781a4dd998878d3c65ce37a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:20.084606 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-b447d838-d13e-42e7-82fa-cce64245e857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:20.218408 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 590/1177] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:25:20 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:25:20.223281 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c3aa0-3e34-4be4-b0b5-334634171735 service neutron] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:20.238157 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c3aa0-3e34-4be4-b0b5-334634171735 service neutron] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:20.253564 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae52afb-a394-4499-ba0e-b43d4db7495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:20.254292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae52afb-a394-4499-ba0e-b43d4db7495c admin admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:20.254621 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae52afb-a394-4499-ba0e-b43d4db7495c admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:20.254935 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae52afb-a394-4499-ba0e-b43d4db7495c admin admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:20.255642 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae52afb-a394-4499-ba0e-b43d4db7495c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:20.257638 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae52afb-a394-4499-ba0e-b43d4db7495c admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:20.323579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 588/1178] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Jul 26 10:25:20 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:25:20.326844 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447d838-d13e-42e7-82fa-cce64245e857 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:20.343009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447d838-d13e-42e7-82fa-cce64245e857 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:20.386352 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:20.457327 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914605e4-b0cc-43cc-afbb-abc0ce88bc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:20.458409 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914605e4-b0cc-43cc-afbb-abc0ce88bc26 admin admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:20.458867 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914605e4-b0cc-43cc-afbb-abc0ce88bc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:20.459304 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914605e4-b0cc-43cc-afbb-abc0ce88bc26 admin admin] PATH_INFO: `/v3/users` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:20.460861 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914605e4-b0cc-43cc-afbb-abc0ce88bc26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:20.463870 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914605e4-b0cc-43cc-afbb-abc0ce88bc26 admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:20.497240 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 591/1179] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Jul 26 10:25:20 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:25:20.503161 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae52afb-a394-4499-ba0e-b43d4db7495c admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:20.540785 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae52afb-a394-4499-ba0e-b43d4db7495c admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:20.560045 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86b582-9aea-459c-9cf3-4fcdaf033b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:20.561650 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86b582-9aea-459c-9cf3-4fcdaf033b05 admin admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:20.561887 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86b582-9aea-459c-9cf3-4fcdaf033b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:20.562393 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86b582-9aea-459c-9cf3-4fcdaf033b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:20.563798 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86b582-9aea-459c-9cf3-4fcdaf033b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:20.567185 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86b582-9aea-459c-9cf3-4fcdaf033b05 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:20.598585 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 589/1180] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:25:20.603780 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914605e4-b0cc-43cc-afbb-abc0ce88bc26 admin admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:20.618301 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914605e4-b0cc-43cc-afbb-abc0ce88bc26 admin admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:20.627328 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb5974-83eb-45e0-a082-486b5235645e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:20.628142 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb5974-83eb-45e0-a082-486b5235645e admin admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:20.628484 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb5974-83eb-45e0-a082-486b5235645e admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:20.629392 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb5974-83eb-45e0-a082-486b5235645e admin admin] PATH_INFO: `/v3/projects/daeea881f8c74182b87a66826b0b29bb/users/87e34456c99047fe9a0585cd2fc69901/roles/7d88b748366a42929784db05d53fe473` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:20.653872 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb5974-83eb-45e0-a082-486b5235645e admin admin] RBAC: Authorizing `identity:create_grant(project_id=daeea881f8c74182b87a66826b0b29bb, user_id=87e34456c99047fe9a0585cd2fc69901, role_id=7d88b748366a42929784db05d53fe473)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:20.659223 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb5974-83eb-45e0-a082-486b5235645e admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:20.693808 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 592/1181] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Jul 26 10:25:20 2022] PUT /identity/v3/projects/daeea881f8c74182b87a66826b0b29bb/users/87e34456c99047fe9a0585cd2fc69901/roles/7d88b748366a42929784db05d53fe473 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:25:20.694856 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86b582-9aea-459c-9cf3-4fcdaf033b05 admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:20.708908 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86b582-9aea-459c-9cf3-4fcdaf033b05 admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:20.762605 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153f893-c388-441b-9e1c-89369c5f8ac2 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:20.762884 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153f893-c388-441b-9e1c-89369c5f8ac2 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:20.763155 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153f893-c388-441b-9e1c-89369c5f8ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:20.802626 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-a153f893-c388-441b-9e1c-89369c5f8ac2 None None] MFA Rules not processed for user `21d4b60c39614760b28eadcb4d2a3fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:20.803857 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-a153f893-c388-441b-9e1c-89369c5f8ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:20.821872 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efccc5-2622-44f7-afcf-80b220d85926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:20.822559 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efccc5-2622-44f7-afcf-80b220d85926 admin admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:20.822837 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efccc5-2622-44f7-afcf-80b220d85926 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:20.823102 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efccc5-2622-44f7-afcf-80b220d85926 admin admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:20.824113 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efccc5-2622-44f7-afcf-80b220d85926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:20.825859 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efccc5-2622-44f7-afcf-80b220d85926 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:20.842182 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 590/1182] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:25:20.843258 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efccc5-2622-44f7-afcf-80b220d85926 admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:20.857933 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efccc5-2622-44f7-afcf-80b220d85926 admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:20.866406 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece7e3f-e1d5-47d9-a168-2a2a9102ce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:20.867013 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece7e3f-e1d5-47d9-a168-2a2a9102ce08 admin admin] REQUEST_METHOD: `PUT` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:20.867254 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece7e3f-e1d5-47d9-a168-2a2a9102ce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:20.867527 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece7e3f-e1d5-47d9-a168-2a2a9102ce08 admin admin] PATH_INFO: `/v3/projects/daeea881f8c74182b87a66826b0b29bb/users/87e34456c99047fe9a0585cd2fc69901/roles/7d88b748366a42929784db05d53fe473` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:20.869815 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece7e3f-e1d5-47d9-a168-2a2a9102ce08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daeea881f8c74182b87a66826b0b29bb, user_id=87e34456c99047fe9a0585cd2fc69901, role_id=7d88b748366a42929784db05d53fe473)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:20.873725 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece7e3f-e1d5-47d9-a168-2a2a9102ce08 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:20.891640 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 591/1183] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Jul 26 10:25:20 2022] PUT /identity/v3/projects/daeea881f8c74182b87a66826b0b29bb/users/87e34456c99047fe9a0585cd2fc69901/roles/7d88b748366a42929784db05d53fe473 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:25:20.917584 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 593/1184] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:25:20 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:20.922182 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece7e3f-e1d5-47d9-a168-2a2a9102ce08 admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:20.981751 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:21.016351 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece7e3f-e1d5-47d9-a168-2a2a9102ce08 admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:21.050710 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bbf6d-9ba7-4662-b0fa-f0140d1396d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:21.051666 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bbf6d-9ba7-4662-b0fa-f0140d1396d1 admin admin] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:21.051666 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bbf6d-9ba7-4662-b0fa-f0140d1396d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:21.051985 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bbf6d-9ba7-4662-b0fa-f0140d1396d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:21.052761 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bbf6d-9ba7-4662-b0fa-f0140d1396d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:21.059138 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bbf6d-9ba7-4662-b0fa-f0140d1396d1 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:21.095866 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 592/1185] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Jul 26 10:25:20 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:25:21.100527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153f893-c388-441b-9e1c-89369c5f8ac2 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:21.119710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153f893-c388-441b-9e1c-89369c5f8ac2 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:21.218910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc06fbd-d034-4649-8710-5aa31d6cefca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:21.219573 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc06fbd-d034-4649-8710-5aa31d6cefca admin admin] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:21.219965 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc06fbd-d034-4649-8710-5aa31d6cefca admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:21.220416 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc06fbd-d034-4649-8710-5aa31d6cefca admin admin] PATH_INFO: `/v3/users` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:21.221157 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc06fbd-d034-4649-8710-5aa31d6cefca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:21.223376 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc06fbd-d034-4649-8710-5aa31d6cefca admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:21.260674 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bbf6d-9ba7-4662-b0fa-f0140d1396d1 admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:21.263769 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 594/1186] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Jul 26 10:25:21 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:25:21.280485 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bbf6d-9ba7-4662-b0fa-f0140d1396d1 admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:21.293472 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc4baf-2fe7-482b-b281-f3eab2f37d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:21.294375 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc4baf-2fe7-482b-b281-f3eab2f37d74 admin admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:21.294842 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc4baf-2fe7-482b-b281-f3eab2f37d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:21.295306 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc4baf-2fe7-482b-b281-f3eab2f37d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:21.296980 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc4baf-2fe7-482b-b281-f3eab2f37d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:21.298853 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc4baf-2fe7-482b-b281-f3eab2f37d74 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:21.317222 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 593/1187] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 10:25:21.318966 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc06fbd-d034-4649-8710-5aa31d6cefca admin admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:21.333416 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc06fbd-d034-4649-8710-5aa31d6cefca admin admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:21.340734 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfe5e2-594d-43b8-b55e-0c58eaf2bee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:21.341405 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfe5e2-594d-43b8-b55e-0c58eaf2bee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:21.341741 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfe5e2-594d-43b8-b55e-0c58eaf2bee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:21.342074 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfe5e2-594d-43b8-b55e-0c58eaf2bee6 admin admin] PATH_INFO: `/v3/projects/ed02b5fa87bf42b0b8b0dba7882df54d/users/d4d8cac7a51f402686d23967e030ae48/roles/7d88b748366a42929784db05d53fe473` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:21.353212 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:21.365699 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfe5e2-594d-43b8-b55e-0c58eaf2bee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed02b5fa87bf42b0b8b0dba7882df54d, user_id=d4d8cac7a51f402686d23967e030ae48, role_id=7d88b748366a42929784db05d53fe473)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:21.369687 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfe5e2-594d-43b8-b55e-0c58eaf2bee6 admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:21.387308 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 595/1188] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Jul 26 10:25:21 2022] PUT /identity/v3/projects/ed02b5fa87bf42b0b8b0dba7882df54d/users/d4d8cac7a51f402686d23967e030ae48/roles/7d88b748366a42929784db05d53fe473 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:25:21.391408 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc4baf-2fe7-482b-b281-f3eab2f37d74 admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:21.405166 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc4baf-2fe7-482b-b281-f3eab2f37d74 admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:21.492222 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f018930-f7e3-4af2-bd29-9b810dc4b6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:21.492760 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f018930-f7e3-4af2-bd29-9b810dc4b6dc admin admin] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:21.493038 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f018930-f7e3-4af2-bd29-9b810dc4b6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:21.493308 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f018930-f7e3-4af2-bd29-9b810dc4b6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:21.494027 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f018930-f7e3-4af2-bd29-9b810dc4b6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:21.495777 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f018930-f7e3-4af2-bd29-9b810dc4b6dc admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:21.510310 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 594/1189] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:25:21.515316 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfe5e2-594d-43b8-b55e-0c58eaf2bee6 admin admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:21.528964 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfe5e2-594d-43b8-b55e-0c58eaf2bee6 admin admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:21.540745 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a41c9-a6a1-4991-b7dd-077edb42491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:21.541632 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a41c9-a6a1-4991-b7dd-077edb42491d admin admin] REQUEST_METHOD: `PUT` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:21.542678 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a41c9-a6a1-4991-b7dd-077edb42491d admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:21.543218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a41c9-a6a1-4991-b7dd-077edb42491d admin admin] PATH_INFO: `/v3/projects/ed02b5fa87bf42b0b8b0dba7882df54d/users/d4d8cac7a51f402686d23967e030ae48/roles/7d88b748366a42929784db05d53fe473` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:21.545419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a41c9-a6a1-4991-b7dd-077edb42491d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed02b5fa87bf42b0b8b0dba7882df54d, user_id=d4d8cac7a51f402686d23967e030ae48, role_id=7d88b748366a42929784db05d53fe473)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:21.548220 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a41c9-a6a1-4991-b7dd-077edb42491d admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:21.561145 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 596/1190] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Jul 26 10:25:21 2022] PUT /identity/v3/projects/ed02b5fa87bf42b0b8b0dba7882df54d/users/d4d8cac7a51f402686d23967e030ae48/roles/7d88b748366a42929784db05d53fe473 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:25:27.445878 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e123e3-009c-4fb1-ba77-a7d5f4f6db99 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:27.447299 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e123e3-009c-4fb1-ba77-a7d5f4f6db99 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:27.447734 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e123e3-009c-4fb1-ba77-a7d5f4f6db99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:27.516258 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-a3e123e3-009c-4fb1-ba77-a7d5f4f6db99 None None] MFA Rules not processed for user `87e34456c99047fe9a0585cd2fc69901`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:27.517724 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-a3e123e3-009c-4fb1-ba77-a7d5f4f6db99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:27.647024 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 595/1191] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:25:27 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:27.663284 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a41c9-a6a1-4991-b7dd-077edb42491d admin admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:27.665324 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-be2a41c9-a6a1-4991-b7dd-077edb42491d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:27.798550 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a41c9-a6a1-4991-b7dd-077edb42491d admin admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:27.809649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d8fd9-c0e7-4f4a-8578-4a44b583e2e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4adbb70e9f46f9a6a416329e8c0bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:27.810590 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d8fd9-c0e7-4f4a-8578-4a44b583e2e8 service glance] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:27.811038 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d8fd9-c0e7-4f4a-8578-4a44b583e2e8 service glance] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:27.811464 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d8fd9-c0e7-4f4a-8578-4a44b583e2e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:27.978410 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d8fd9-c0e7-4f4a-8578-4a44b583e2e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:27.983117 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d8fd9-c0e7-4f4a-8578-4a44b583e2e8 service glance] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:27.996319 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 597/1192] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:27 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:25:28.561448 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4c857-1f80-4731-ac75-8f09c1e2c54b None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:28.562415 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4c857-1f80-4731-ac75-8f09c1e2c54b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:28.562853 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4c857-1f80-4731-ac75-8f09c1e2c54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:28.603477 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-80a4c857-1f80-4731-ac75-8f09c1e2c54b None None] MFA Rules not processed for user `d4d8cac7a51f402686d23967e030ae48`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:28.605173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-80a4c857-1f80-4731-ac75-8f09c1e2c54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:28.650797 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:28.725205 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 596/1193] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:25:28 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:28.740331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d8fd9-c0e7-4f4a-8578-4a44b583e2e8 service glance] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:28.758190 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d8fd9-c0e7-4f4a-8578-4a44b583e2e8 service glance] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:28.762524 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c151e-ac29-4357-b1da-758c87b7aac4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4adbb70e9f46f9a6a416329e8c0bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:28.763517 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c151e-ac29-4357-b1da-758c87b7aac4 service glance] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:28.764034 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c151e-ac29-4357-b1da-758c87b7aac4 service glance] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:28.764501 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c151e-ac29-4357-b1da-758c87b7aac4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:28.919415 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c151e-ac29-4357-b1da-758c87b7aac4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:28.922236 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c151e-ac29-4357-b1da-758c87b7aac4 service glance] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:28.939185 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 598/1194] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:28 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:25:36.994611 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b7591-1cc1-4ee6-91d7-10495ba60661 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:36.995211 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b7591-1cc1-4ee6-91d7-10495ba60661 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:36.995361 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b7591-1cc1-4ee6-91d7-10495ba60661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:37.020688 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-d00b7591-1cc1-4ee6-91d7-10495ba60661 None None] MFA Rules not processed for user `eb539e1e781a4dd998878d3c65ce37a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:37.024779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-d00b7591-1cc1-4ee6-91d7-10495ba60661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:37.032707 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 597/1195] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:25:36 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:37.329273 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ca36d-0b22-4764-86f8-194b94f55243 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:37.329929 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ca36d-0b22-4764-86f8-194b94f55243 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:37.329929 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ca36d-0b22-4764-86f8-194b94f55243 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:37.332094 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 599/1196] 10.222.0.60 () {54 vars in 962 bytes} [Tue Jul 26 10:25:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:25:37.338699 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba327f42-fd93-48d1-bb4e-9c1e8700cede None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:37.339202 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba327f42-fd93-48d1-bb4e-9c1e8700cede None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:37.339713 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba327f42-fd93-48d1-bb4e-9c1e8700cede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:37.374702 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-ba327f42-fd93-48d1-bb4e-9c1e8700cede None None] MFA Rules not processed for user `d68b323bc2b54984ad2ed0d248675624`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:37.375950 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-ba327f42-fd93-48d1-bb4e-9c1e8700cede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:37.462871 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 598/1197] 10.222.0.60 () {58 vars in 1059 bytes} [Tue Jul 26 10:25:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:37.470317 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2b994-4efd-4652-abb5-66d0c56d7746 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:37.470697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2b994-4efd-4652-abb5-66d0c56d7746 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:37.470975 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2b994-4efd-4652-abb5-66d0c56d7746 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:37.472651 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 600/1198] 10.222.0.60 () {54 vars in 912 bytes} [Tue Jul 26 10:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:25:37.479160 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efbf0d-0adc-4c95-b16a-4a4fd818e1fe None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:37.479918 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efbf0d-0adc-4c95-b16a-4a4fd818e1fe None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:37.480394 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efbf0d-0adc-4c95-b16a-4a4fd818e1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:37.508993 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-a0efbf0d-0adc-4c95-b16a-4a4fd818e1fe None None] MFA Rules not processed for user `d68b323bc2b54984ad2ed0d248675624`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:37.510500 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-a0efbf0d-0adc-4c95-b16a-4a4fd818e1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:37.529957 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 599/1199] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Jul 26 10:25:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:37.548494 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2b994-4efd-4652-abb5-66d0c56d7746 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:37.550673 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-00e2b994-4efd-4652-abb5-66d0c56d7746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:37.569587 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2b994-4efd-4652-abb5-66d0c56d7746 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:37.574194 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f62d0-00cf-4fa4-928a-fccd9b32985b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4adbb70e9f46f9a6a416329e8c0bf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:37.574905 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f62d0-00cf-4fa4-928a-fccd9b32985b service glance] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:37.575900 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f62d0-00cf-4fa4-928a-fccd9b32985b service glance] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:37.576181 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f62d0-00cf-4fa4-928a-fccd9b32985b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:37.591055 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f62d0-00cf-4fa4-928a-fccd9b32985b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:37.593395 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f62d0-00cf-4fa4-928a-fccd9b32985b service glance] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:37.609840 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 601/1200] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:37 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:25:38.105615 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3a8eb-ebcb-4573-bd40-ce430afe624a None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:38.106138 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3a8eb-ebcb-4573-bd40-ce430afe624a None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:38.106138 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3a8eb-ebcb-4573-bd40-ce430afe624a None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:38.107419 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 600/1201] 10.222.0.60 () {54 vars in 912 bytes} [Tue Jul 26 10:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:25:38.112728 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5db2a-9f14-4268-a6cd-19b89ac7489e None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:38.113013 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5db2a-9f14-4268-a6cd-19b89ac7489e None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:38.113289 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5db2a-9f14-4268-a6cd-19b89ac7489e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:38.121507 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:38.147031 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-7ea5db2a-9f14-4268-a6cd-19b89ac7489e None None] MFA Rules not processed for user `c2ed2d73e1984404b8099b18a9bb7594`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:38.148587 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-7ea5db2a-9f14-4268-a6cd-19b89ac7489e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:38.201980 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 602/1202] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Jul 26 10:25:38 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:38.213819 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3a8eb-ebcb-4573-bd40-ce430afe624a None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:38.225105 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3a8eb-ebcb-4573-bd40-ce430afe624a None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:38.229061 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe117e2-6709-45ac-8709-fafb00bfc8b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:38.230630 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe117e2-6709-45ac-8709-fafb00bfc8b2 service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:38.231185 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe117e2-6709-45ac-8709-fafb00bfc8b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:38.231457 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe117e2-6709-45ac-8709-fafb00bfc8b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:38.238852 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe117e2-6709-45ac-8709-fafb00bfc8b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:38.240278 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe117e2-6709-45ac-8709-fafb00bfc8b2 service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:38.248262 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 601/1203] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:38 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:25:38.671195 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4a94c-c8b9-4ed9-81af-867ab7c40057 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:38.672649 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4a94c-c8b9-4ed9-81af-867ab7c40057 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:38.673083 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4a94c-c8b9-4ed9-81af-867ab7c40057 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:38.674510 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 603/1204] 10.222.0.60 () {54 vars in 962 bytes} [Tue Jul 26 10:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:25:38.680561 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7d3e8-ea17-4855-9687-d085848fe95b None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:38.680935 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7d3e8-ea17-4855-9687-d085848fe95b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:38.681451 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7d3e8-ea17-4855-9687-d085848fe95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:38.691132 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e9d43-94ee-4016-b862-94b2b2591935 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:38.691132 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e9d43-94ee-4016-b862-94b2b2591935 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:38.691132 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e9d43-94ee-4016-b862-94b2b2591935 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:38.693934 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 604/1205] 10.222.0.60 () {54 vars in 961 bytes} [Tue Jul 26 10:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:25:38.700133 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2353cd-c477-42bb-851e-6ba557aca4be None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:38.700416 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2353cd-c477-42bb-851e-6ba557aca4be None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:38.700691 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2353cd-c477-42bb-851e-6ba557aca4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:38.708913 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-3da7d3e8-ea17-4855-9687-d085848fe95b None None] MFA Rules not processed for user `d68b323bc2b54984ad2ed0d248675624`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:38.710689 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-3da7d3e8-ea17-4855-9687-d085848fe95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:38.722589 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 602/1206] 10.222.0.60 () {58 vars in 1059 bytes} [Tue Jul 26 10:25:38 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:38.728207 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784437-02d4-4b44-bd81-62eb88e4a5c8 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:38.728502 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784437-02d4-4b44-bd81-62eb88e4a5c8 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:38.728784 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784437-02d4-4b44-bd81-62eb88e4a5c8 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:38.730284 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 603/1207] 10.222.0.60 () {54 vars in 912 bytes} [Tue Jul 26 10:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:25:38.730409 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-0d2353cd-c477-42bb-851e-6ba557aca4be None None] MFA Rules not processed for user `32a61a4fe5c74444af1afdbeaf9be512`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:38.731442 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-0d2353cd-c477-42bb-851e-6ba557aca4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:38.735737 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf141045-3b9d-490a-9c0d-3456078337be None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:38.736023 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf141045-3b9d-490a-9c0d-3456078337be None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:38.736319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf141045-3b9d-490a-9c0d-3456078337be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:38.756199 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-bf141045-3b9d-490a-9c0d-3456078337be None None] MFA Rules not processed for user `d68b323bc2b54984ad2ed0d248675624`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:38.757427 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-bf141045-3b9d-490a-9c0d-3456078337be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:38.772242 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 604/1208] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Jul 26 10:25:38 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:25:38.791490 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf141045-3b9d-490a-9c0d-3456078337be None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:38.801191 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf141045-3b9d-490a-9c0d-3456078337be None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:38.805907 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e8367-0564-4f9a-837e-42c589d7dd0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:38.806601 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e8367-0564-4f9a-837e-42c589d7dd0f service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:38.806884 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e8367-0564-4f9a-837e-42c589d7dd0f service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:38.807156 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e8367-0564-4f9a-837e-42c589d7dd0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:38.808524 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 605/1209] 10.222.0.60 () {58 vars in 1058 bytes} [Tue Jul 26 10:25:38 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:25:38.816013 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2353cd-c477-42bb-851e-6ba557aca4be None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:38.828218 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2353cd-c477-42bb-851e-6ba557aca4be None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:38.828573 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e8367-0564-4f9a-837e-42c589d7dd0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:38.831129 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e8367-0564-4f9a-837e-42c589d7dd0f service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:38.834633 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da10d73-d3d4-4149-b085-ffbe8908a2a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a61a4fe5c74444af1afdbeaf9be512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:38.835279 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10d73-d3d4-4149-b085-ffbe8908a2a5 service placement] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:38.835556 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10d73-d3d4-4149-b085-ffbe8908a2a5 service placement] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:38.835827 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10d73-d3d4-4149-b085-ffbe8908a2a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:38.837661 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-6da10d73-d3d4-4149-b085-ffbe8908a2a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:38.850089 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da10d73-d3d4-4149-b085-ffbe8908a2a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:38.851777 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da10d73-d3d4-4149-b085-ffbe8908a2a5 service placement] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:38.853391 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 605/1210] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:38 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:25:38.863375 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 606/1211] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:38 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:25:48.843857 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=76 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:48.858472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=62 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:50.605791 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cde4ae-3b82-45df-a180-ba4bf822dba6 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:50.606420 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cde4ae-3b82-45df-a180-ba4bf822dba6 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:50.606420 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cde4ae-3b82-45df-a180-ba4bf822dba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:50.627065 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-89cde4ae-3b82-45df-a180-ba4bf822dba6 None None] MFA Rules not processed for user `c2ed2d73e1984404b8099b18a9bb7594`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:50.628302 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-89cde4ae-3b82-45df-a180-ba4bf822dba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:50.634896 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 606/1212] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Jul 26 10:25:50 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:50.648928 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da10d73-d3d4-4149-b085-ffbe8908a2a5 service placement] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:50.659712 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da10d73-d3d4-4149-b085-ffbe8908a2a5 service placement] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:50.663772 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff894822-a4fe-4c04-90cb-b8c1db03c634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:50.664894 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff894822-a4fe-4c04-90cb-b8c1db03c634 service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:50.664894 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff894822-a4fe-4c04-90cb-b8c1db03c634 service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:50.665127 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff894822-a4fe-4c04-90cb-b8c1db03c634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:50.674333 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff894822-a4fe-4c04-90cb-b8c1db03c634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:50.675838 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff894822-a4fe-4c04-90cb-b8c1db03c634 service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:50.684815 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 607/1213] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:50 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:25:51.659510 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197af527-03e1-4d60-8d00-de118775f100 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:51.660564 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197af527-03e1-4d60-8d00-de118775f100 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:51.661344 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197af527-03e1-4d60-8d00-de118775f100 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:51.666110 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 607/1214] 10.222.0.60 () {54 vars in 921 bytes} [Tue Jul 26 10:25:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:25:51.716825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17ae00-6388-4921-b53f-43a534af2e2d None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:51.717457 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17ae00-6388-4921-b53f-43a534af2e2d None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:51.717800 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17ae00-6388-4921-b53f-43a534af2e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:51.745825 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-2e17ae00-6388-4921-b53f-43a534af2e2d None None] MFA Rules not processed for user `d68b323bc2b54984ad2ed0d248675624`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:51.747467 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-2e17ae00-6388-4921-b53f-43a534af2e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:51.758419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 608/1215] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Jul 26 10:25:51 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:51.773125 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197af527-03e1-4d60-8d00-de118775f100 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:51.789074 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197af527-03e1-4d60-8d00-de118775f100 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:51.794951 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a1ae2-b25f-4b9d-b0c6-7c1b849e575e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:51.795680 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a1ae2-b25f-4b9d-b0c6-7c1b849e575e service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:51.796067 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a1ae2-b25f-4b9d-b0c6-7c1b849e575e service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:51.796435 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a1ae2-b25f-4b9d-b0c6-7c1b849e575e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:51.806317 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a1ae2-b25f-4b9d-b0c6-7c1b849e575e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:51.808059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a1ae2-b25f-4b9d-b0c6-7c1b849e575e service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:51.820113 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 608/1216] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:51 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:25:59.500302 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c13454-23c5-444d-a98d-a518a676cc4a None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:59.500910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c13454-23c5-444d-a98d-a518a676cc4a None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:59.501318 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c13454-23c5-444d-a98d-a518a676cc4a None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:59.503207 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 609/1217] 10.222.0.60 () {54 vars in 921 bytes} [Tue Jul 26 10:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:25:59.513226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8c380-f00f-44e6-8498-c675296c69ab None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:59.513823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8c380-f00f-44e6-8498-c675296c69ab None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:59.513823 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8c380-f00f-44e6-8498-c675296c69ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:59.537998 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-b4b8c380-f00f-44e6-8498-c675296c69ab None None] MFA Rules not processed for user `d68b323bc2b54984ad2ed0d248675624`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:59.539251 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-b4b8c380-f00f-44e6-8498-c675296c69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:59.548579 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 609/1218] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Jul 26 10:25:59 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:59.566342 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c13454-23c5-444d-a98d-a518a676cc4a None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:59.580655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c13454-23c5-444d-a98d-a518a676cc4a None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:59.590077 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a847887-d4b0-427c-8074-4e51ad648e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:59.590077 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a847887-d4b0-427c-8074-4e51ad648e56 service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:59.590077 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a847887-d4b0-427c-8074-4e51ad648e56 service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:59.590077 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a847887-d4b0-427c-8074-4e51ad648e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:59.598717 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a847887-d4b0-427c-8074-4e51ad648e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:59.600347 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a847887-d4b0-427c-8074-4e51ad648e56 service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:59.611016 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 610/1219] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:59 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:26:09.532972 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=12 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:26:09.606438 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=15 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:26:11.962131 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8c380-f00f-44e6-8498-c675296c69ab None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:26:11.978483 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8c380-f00f-44e6-8498-c675296c69ab None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:26:11.982693 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19df7d-9085-45b9-acda-f92a710ff18e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:26:11.983437 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19df7d-9085-45b9-acda-f92a710ff18e service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:26:11.983721 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19df7d-9085-45b9-acda-f92a710ff18e service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:26:11.983990 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19df7d-9085-45b9-acda-f92a710ff18e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:26:11.997107 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19df7d-9085-45b9-acda-f92a710ff18e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:26:11.998644 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19df7d-9085-45b9-acda-f92a710ff18e service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:26:12.012773 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 610/1220] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:26:11 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:26:22.007359 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=6 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:26:30.319671 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f6200-cef6-4488-8452-4789cfb58d54 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:26:30.320272 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f6200-cef6-4488-8452-4789cfb58d54 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:26:30.320272 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f6200-cef6-4488-8452-4789cfb58d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:26:30.340791 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-401f6200-cef6-4488-8452-4789cfb58d54 None None] MFA Rules not processed for user `21d4b60c39614760b28eadcb4d2a3fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:26:30.342035 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-401f6200-cef6-4488-8452-4789cfb58d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:26:30.350320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 611/1221] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:26:30 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:26:40.335453 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=3 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:26:49.819013 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2d826-a503-41c9-a86b-6cdb6fe05155 None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:26:49.819513 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2d826-a503-41c9-a86b-6cdb6fe05155 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:26:49.819614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2d826-a503-41c9-a86b-6cdb6fe05155 None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:26:49.821327 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 611/1222] 10.222.0.60 () {54 vars in 921 bytes} [Tue Jul 26 10:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:26:49.828225 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1808f0e-97e8-4ea5-b13a-8fabaec56e72 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:26:49.829089 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1808f0e-97e8-4ea5-b13a-8fabaec56e72 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:26:49.829376 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1808f0e-97e8-4ea5-b13a-8fabaec56e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:26:49.853697 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-f1808f0e-97e8-4ea5-b13a-8fabaec56e72 None None] MFA Rules not processed for user `d68b323bc2b54984ad2ed0d248675624`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:26:49.854958 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-f1808f0e-97e8-4ea5-b13a-8fabaec56e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:26:49.865117 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 612/1223] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Jul 26 10:26:49 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:26:49.878653 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2d826-a503-41c9-a86b-6cdb6fe05155 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:26:49.892754 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2d826-a503-41c9-a86b-6cdb6fe05155 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:26:49.898361 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7736c-ff0f-4ae5-9eaf-7992f3d62e5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:26:49.899016 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7736c-ff0f-4ae5-9eaf-7992f3d62e5e service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:26:49.899329 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7736c-ff0f-4ae5-9eaf-7992f3d62e5e service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:26:49.899553 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7736c-ff0f-4ae5-9eaf-7992f3d62e5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:26:49.909050 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7736c-ff0f-4ae5-9eaf-7992f3d62e5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:26:49.910678 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7736c-ff0f-4ae5-9eaf-7992f3d62e5e service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:26:49.921331 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 612/1224] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:26:49 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:26:54.794688 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c335cd2-0713-49af-8d84-b272068e0ff0 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:26:54.795251 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c335cd2-0713-49af-8d84-b272068e0ff0 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:26:54.795251 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c335cd2-0713-49af-8d84-b272068e0ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:26:54.815924 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-1c335cd2-0713-49af-8d84-b272068e0ff0 None None] MFA Rules not processed for user `21d4b60c39614760b28eadcb4d2a3fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:26:54.817183 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-1c335cd2-0713-49af-8d84-b272068e0ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:26:54.824485 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 613/1225] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:26:54 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:26:55.117888 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aed941-3ee5-43b4-a4e7-f21224f9ab5a None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:26:55.118659 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aed941-3ee5-43b4-a4e7-f21224f9ab5a None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:26:55.118659 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aed941-3ee5-43b4-a4e7-f21224f9ab5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:26:55.145226 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-b1aed941-3ee5-43b4-a4e7-f21224f9ab5a None None] MFA Rules not processed for user `c2ed2d73e1984404b8099b18a9bb7594`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:26:55.146491 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-b1aed941-3ee5-43b4-a4e7-f21224f9ab5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:26:55.154361 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 613/1226] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Jul 26 10:26:55 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:26:55.170394 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c335cd2-0713-49af-8d84-b272068e0ff0 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:26:55.184009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c335cd2-0713-49af-8d84-b272068e0ff0 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:26:55.188468 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594eeceb-098b-4938-8707-7c1880ac4faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:26:55.188849 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eeceb-098b-4938-8707-7c1880ac4faa service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:26:55.189123 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eeceb-098b-4938-8707-7c1880ac4faa service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:26:55.189389 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eeceb-098b-4938-8707-7c1880ac4faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:26:55.197920 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594eeceb-098b-4938-8707-7c1880ac4faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:26:55.199462 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594eeceb-098b-4938-8707-7c1880ac4faa service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:26:55.208355 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 614/1227] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:26:55 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:27:05.134314 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=9 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:27:05.204542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=12 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:27:11.152779 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e39fa1-c07a-470a-9f9c-92131bc8744e None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:27:11.153392 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e39fa1-c07a-470a-9f9c-92131bc8744e None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:27:11.153392 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e39fa1-c07a-470a-9f9c-92131bc8744e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:27:11.177322 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-d4e39fa1-c07a-470a-9f9c-92131bc8744e None None] MFA Rules not processed for user `21d4b60c39614760b28eadcb4d2a3fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:27:11.178628 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-d4e39fa1-c07a-470a-9f9c-92131bc8744e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:27:11.186882 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 614/1228] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:27:11 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:27:21.169268 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=3 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:28:10.412567 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a57f4-8925-493c-87e9-29215c4e0fa6 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:28:10.413376 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a57f4-8925-493c-87e9-29215c4e0fa6 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:28:10.413376 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a57f4-8925-493c-87e9-29215c4e0fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:28:10.439459 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-8f5a57f4-8925-493c-87e9-29215c4e0fa6 None None] MFA Rules not processed for user `21d4b60c39614760b28eadcb4d2a3fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:28:10.440674 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-8f5a57f4-8925-493c-87e9-29215c4e0fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:28:10.448914 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 615/1229] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:28:10 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:28:20.434020 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=3 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:28:23.350611 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e39fa1-c07a-470a-9f9c-92131bc8744e None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:28:23.371589 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e39fa1-c07a-470a-9f9c-92131bc8744e None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:28:23.376168 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dd6cc-e2a9-4567-af67-52ac8238160c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:28:23.376790 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dd6cc-e2a9-4567-af67-52ac8238160c service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:28:23.377069 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dd6cc-e2a9-4567-af67-52ac8238160c service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:28:23.377337 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dd6cc-e2a9-4567-af67-52ac8238160c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:28:23.387930 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5dd6cc-e2a9-4567-af67-52ac8238160c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:28:23.389397 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5dd6cc-e2a9-4567-af67-52ac8238160c service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:28:23.399576 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 615/1230] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:28:23 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:28:33.395261 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=10 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:28:38.487151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a57f4-8925-493c-87e9-29215c4e0fa6 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:28:38.519705 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a57f4-8925-493c-87e9-29215c4e0fa6 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:28:38.525143 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6668c9-86aa-4223-bd0a-25f2d9b79da4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a61a4fe5c74444af1afdbeaf9be512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:28:38.525774 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6668c9-86aa-4223-bd0a-25f2d9b79da4 service placement] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:28:38.526053 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6668c9-86aa-4223-bd0a-25f2d9b79da4 service placement] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:28:38.526325 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6668c9-86aa-4223-bd0a-25f2d9b79da4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:28:38.535450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6668c9-86aa-4223-bd0a-25f2d9b79da4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:28:38.537053 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6668c9-86aa-4223-bd0a-25f2d9b79da4 service placement] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:28:38.547620 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 616/1231] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:28:38 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:28:48.543304 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=10 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:30:30.389383 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dd6cc-e2a9-4567-af67-52ac8238160c service neutron] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:30:30.415249 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dd6cc-e2a9-4567-af67-52ac8238160c service neutron] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:30:30.420831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9da64-2645-4654-a3c8-eeb3929eaf19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:30:30.421458 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9da64-2645-4654-a3c8-eeb3929eaf19 service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:30.421864 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9da64-2645-4654-a3c8-eeb3929eaf19 service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:30.422139 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9da64-2645-4654-a3c8-eeb3929eaf19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:30.432272 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9da64-2645-4654-a3c8-eeb3929eaf19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:30:30.433941 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9da64-2645-4654-a3c8-eeb3929eaf19 service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:30:30.444984 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 616/1232] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:30:30 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:30:34.264505 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39a2ad-acf3-4bc0-a4d6-a73adbd061e3 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:34.265019 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39a2ad-acf3-4bc0-a4d6-a73adbd061e3 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:34.265164 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39a2ad-acf3-4bc0-a4d6-a73adbd061e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:34.290794 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-8d39a2ad-acf3-4bc0-a4d6-a73adbd061e3 None None] MFA Rules not processed for user `21d4b60c39614760b28eadcb4d2a3fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:30:34.292057 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-8d39a2ad-acf3-4bc0-a4d6-a73adbd061e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:30:34.301320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 617/1233] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:30:34 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:30:38.668294 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9da64-2645-4654-a3c8-eeb3929eaf19 service nova] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:30:38.678544 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9da64-2645-4654-a3c8-eeb3929eaf19 service nova] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:30:38.684492 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3d387-8c1c-4778-a9a0-dcf5b951eb92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:30:38.684492 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3d387-8c1c-4778-a9a0-dcf5b951eb92 service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:38.684492 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3d387-8c1c-4778-a9a0-dcf5b951eb92 service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:38.684492 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3d387-8c1c-4778-a9a0-dcf5b951eb92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:38.695292 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3d387-8c1c-4778-a9a0-dcf5b951eb92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:30:38.696742 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3d387-8c1c-4778-a9a0-dcf5b951eb92 service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:30:38.708901 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 617/1234] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:30:38 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:30:39.898652 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39a2ad-acf3-4bc0-a4d6-a73adbd061e3 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:30:39.909520 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39a2ad-acf3-4bc0-a4d6-a73adbd061e3 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:30:39.914631 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533f4dc-c3b3-4c7c-a5e8-d2e4d5a099fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:30:39.915251 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533f4dc-c3b3-4c7c-a5e8-d2e4d5a099fa service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:39.915525 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533f4dc-c3b3-4c7c-a5e8-d2e4d5a099fa service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:39.915793 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533f4dc-c3b3-4c7c-a5e8-d2e4d5a099fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:39.926395 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533f4dc-c3b3-4c7c-a5e8-d2e4d5a099fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:30:39.927870 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533f4dc-c3b3-4c7c-a5e8-d2e4d5a099fa service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:30:39.938151 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 618/1235] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:30:39 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:30:48.703581 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=16 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:30:49.933900 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=9 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:30:56.816765 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3d387-8c1c-4778-a9a0-dcf5b951eb92 service neutron] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:30:56.828738 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3d387-8c1c-4778-a9a0-dcf5b951eb92 service neutron] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:30:56.834734 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b961d0-f048-430e-a680-b93df62705ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:30:56.835363 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b961d0-f048-430e-a680-b93df62705ac service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:56.835674 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b961d0-f048-430e-a680-b93df62705ac service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:56.835963 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b961d0-f048-430e-a680-b93df62705ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:56.844646 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b961d0-f048-430e-a680-b93df62705ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:30:56.846225 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b961d0-f048-430e-a680-b93df62705ac service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:30:56.859033 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 618/1236] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:30:56 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:30:57.383325 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533f4dc-c3b3-4c7c-a5e8-d2e4d5a099fa service neutron] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:30:57.397620 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533f4dc-c3b3-4c7c-a5e8-d2e4d5a099fa service neutron] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:30:57.405542 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a68dc-e022-4488-8d7e-6697813f77fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:30:57.406787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a68dc-e022-4488-8d7e-6697813f77fb service nova] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:57.407168 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a68dc-e022-4488-8d7e-6697813f77fb service nova] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:57.408416 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a68dc-e022-4488-8d7e-6697813f77fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:57.419612 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a68dc-e022-4488-8d7e-6697813f77fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:30:57.425022 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a68dc-e022-4488-8d7e-6697813f77fb service nova] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:30:57.437610 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 619/1237] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:30:57 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:30:57.521886 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b961d0-f048-430e-a680-b93df62705ac service nova] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:30:57.532277 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b961d0-f048-430e-a680-b93df62705ac service nova] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:30:57.536485 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9783b-bcd8-4274-a61e-abf300946789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:30:57.537490 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9783b-bcd8-4274-a61e-abf300946789 service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:57.537986 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9783b-bcd8-4274-a61e-abf300946789 service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:57.538502 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9783b-bcd8-4274-a61e-abf300946789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:57.549041 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9783b-bcd8-4274-a61e-abf300946789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:30:57.550591 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9783b-bcd8-4274-a61e-abf300946789 service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:30:57.561681 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 619/1238] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:30:57 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:31:07.431875 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=6 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:31:07.556795 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=12 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:31:11.624696 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87feff-8023-4655-bc04-a685e7f483cb None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:31:11.625243 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87feff-8023-4655-bc04-a685e7f483cb None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:31:11.625785 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87feff-8023-4655-bc04-a685e7f483cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:31:11.647387 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-cb87feff-8023-4655-bc04-a685e7f483cb None None] MFA Rules not processed for user `eb539e1e781a4dd998878d3c65ce37a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:31:11.648787 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-cb87feff-8023-4655-bc04-a685e7f483cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:31:11.656472 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 620/1239] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:31:11 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:31:11.945389 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9783b-bcd8-4274-a61e-abf300946789 service neutron] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:31:11.954458 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9783b-bcd8-4274-a61e-abf300946789 service neutron] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:31:11.958835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d15a5-b075-447e-8a7b-b2bd673088c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:31:11.959447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d15a5-b075-447e-8a7b-b2bd673088c6 service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:31:11.959722 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d15a5-b075-447e-8a7b-b2bd673088c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:31:11.959984 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d15a5-b075-447e-8a7b-b2bd673088c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:31:11.968889 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d15a5-b075-447e-8a7b-b2bd673088c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:31:11.970888 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d15a5-b075-447e-8a7b-b2bd673088c6 service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:31:11.980778 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 620/1240] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:31:11 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:31:12.316182 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87feff-8023-4655-bc04-a685e7f483cb None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:31:12.330961 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87feff-8023-4655-bc04-a685e7f483cb None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:31:12.336405 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71801dc7-216f-4848-a100-9ed4bae422aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a61a4fe5c74444af1afdbeaf9be512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:31:12.337211 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71801dc7-216f-4848-a100-9ed4bae422aa service placement] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:31:12.337527 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71801dc7-216f-4848-a100-9ed4bae422aa service placement] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:31:12.337854 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71801dc7-216f-4848-a100-9ed4bae422aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:31:12.348322 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71801dc7-216f-4848-a100-9ed4bae422aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:31:12.350216 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71801dc7-216f-4848-a100-9ed4bae422aa service placement] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:31:12.362638 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 621/1241] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:31:12 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:31:21.976691 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=6 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:31:22.357781 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=9 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:31:29.331474 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d15a5-b075-447e-8a7b-b2bd673088c6 service neutron] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:31:29.344911 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d15a5-b075-447e-8a7b-b2bd673088c6 service neutron] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:31:29.351109 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d0955-c148-4508-8b83-f9c1975fd5d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:31:29.351799 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d0955-c148-4508-8b83-f9c1975fd5d2 service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:31:29.352080 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d0955-c148-4508-8b83-f9c1975fd5d2 service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:31:29.352353 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d0955-c148-4508-8b83-f9c1975fd5d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:31:29.361653 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d0955-c148-4508-8b83-f9c1975fd5d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:31:29.363352 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d0955-c148-4508-8b83-f9c1975fd5d2 service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:31:29.374021 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 621/1242] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:31:29 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:31:37.305189 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71801dc7-216f-4848-a100-9ed4bae422aa service placement] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:31:37.316474 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71801dc7-216f-4848-a100-9ed4bae422aa service placement] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:31:37.320325 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae130a4-6332-463f-b357-22954effcf28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:31:37.321013 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae130a4-6332-463f-b357-22954effcf28 service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:31:37.321321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae130a4-6332-463f-b357-22954effcf28 service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:31:37.321721 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae130a4-6332-463f-b357-22954effcf28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:31:37.334902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae130a4-6332-463f-b357-22954effcf28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:31:37.336480 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae130a4-6332-463f-b357-22954effcf28 service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:31:37.349208 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 622/1243] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:31:37 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:31:39.370024 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=6 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:31:47.343008 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=6 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:32:30.863628 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029584a0-576f-4e01-a79c-6cb6c983691b None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:32:30.864213 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029584a0-576f-4e01-a79c-6cb6c983691b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:32:30.864213 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029584a0-576f-4e01-a79c-6cb6c983691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:32:30.887988 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-029584a0-576f-4e01-a79c-6cb6c983691b None None] MFA Rules not processed for user `21d4b60c39614760b28eadcb4d2a3fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:32:30.889197 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-029584a0-576f-4e01-a79c-6cb6c983691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:32:30.897330 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 622/1244] 10.222.0.60 () {58 vars in 958 bytes} [Tue Jul 26 10:32:30 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:32:40.882307 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=3 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:33:40.504152 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae130a4-6332-463f-b357-22954effcf28 service neutron] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:33:40.571236 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae130a4-6332-463f-b357-22954effcf28 service neutron] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:33:40.576857 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994c0e4-89ca-43a9-b372-89df0799da84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a61a4fe5c74444af1afdbeaf9be512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:33:40.577484 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994c0e4-89ca-43a9-b372-89df0799da84 service placement] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:33:40.577761 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994c0e4-89ca-43a9-b372-89df0799da84 service placement] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:33:40.578034 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994c0e4-89ca-43a9-b372-89df0799da84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:33:40.580052 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-4994c0e4-89ca-43a9-b372-89df0799da84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:33:40.635041 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994c0e4-89ca-43a9-b372-89df0799da84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:33:40.637162 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994c0e4-89ca-43a9-b372-89df0799da84 service placement] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:33:40.653471 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 623/1245] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:33:40 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:33:50.647072 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=33 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:34:22.456006 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029584a0-576f-4e01-a79c-6cb6c983691b None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:22.457719 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-029584a0-576f-4e01-a79c-6cb6c983691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:34:22.484514 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029584a0-576f-4e01-a79c-6cb6c983691b None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:22.488334 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be96c9-8323-4444-8cd1-bc3acc894fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:22.488964 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be96c9-8323-4444-8cd1-bc3acc894fce service neutron] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:22.489232 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be96c9-8323-4444-8cd1-bc3acc894fce service neutron] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:22.489492 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be96c9-8323-4444-8cd1-bc3acc894fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:22.564476 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be96c9-8323-4444-8cd1-bc3acc894fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:22.565915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be96c9-8323-4444-8cd1-bc3acc894fce service neutron] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:22.589447 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 623/1246] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:34:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:34:25.953497 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf42c4d-8746-478f-9cbe-ab66a48ec311 None None] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:25.954152 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf42c4d-8746-478f-9cbe-ab66a48ec311 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:25.954328 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf42c4d-8746-478f-9cbe-ab66a48ec311 None None] PATH_INFO: `/` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:25.956450 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 624/1247] 10.222.0.60 () {54 vars in 921 bytes} [Tue Jul 26 10:34:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:34:25.990831 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b3bb2-60dd-42e9-9b24-e47fa4e3df11 None None] REQUEST_METHOD: `POST` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:25.991394 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b3bb2-60dd-42e9-9b24-e47fa4e3df11 None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:25.991394 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b3bb2-60dd-42e9-9b24-e47fa4e3df11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:26.059136 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.auth.core [None req-597b3bb2-60dd-42e9-9b24-e47fa4e3df11 None None] MFA Rules not processed for user `32a61a4fe5c74444af1afdbeaf9be512`. Rule list: `[]` (Enabled: `True`). {{(pid=87124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:34:26.060290 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-597b3bb2-60dd-42e9-9b24-e47fa4e3df11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:34:26.069520 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 624/1248] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Jul 26 10:34:25 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:34:26.081041 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf42c4d-8746-478f-9cbe-ab66a48ec311 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:26.094135 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf42c4d-8746-478f-9cbe-ab66a48ec311 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:26.099300 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc47a3-6d2d-43e1-a715-306d121bff3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a61a4fe5c74444af1afdbeaf9be512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:26.099917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc47a3-6d2d-43e1-a715-306d121bff3b service placement] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:26.100193 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc47a3-6d2d-43e1-a715-306d121bff3b service placement] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:26.100498 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc47a3-6d2d-43e1-a715-306d121bff3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:26.112666 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc47a3-6d2d-43e1-a715-306d121bff3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:26.114276 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc47a3-6d2d-43e1-a715-306d121bff3b service placement] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:26.124576 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 625/1249] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:34:26 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:34:29.631827 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b3bb2-60dd-42e9-9b24-e47fa4e3df11 None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:29.646381 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b3bb2-60dd-42e9-9b24-e47fa4e3df11 None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:29.655066 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee0869-b520-4e0f-8c50-84d9354bdc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:29.655842 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee0869-b520-4e0f-8c50-84d9354bdc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:29.656189 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee0869-b520-4e0f-8c50-84d9354bdc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:29.656533 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee0869-b520-4e0f-8c50-84d9354bdc67 admin admin] PATH_INFO: `/v3/users/eb539e1e781a4dd998878d3c65ce37a7` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:29.657990 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee0869-b520-4e0f-8c50-84d9354bdc67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb539e1e781a4dd998878d3c65ce37a7)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:29.659645 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: WARNING py.warnings [None req-67ee0869-b520-4e0f-8c50-84d9354bdc67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:34:29.659645 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: warnings.warn(msg) Jul 26 10:34:29.659645 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: Jul 26 10:34:29.661006 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee0869-b520-4e0f-8c50-84d9354bdc67 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:29.738377 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-67ee0869-b520-4e0f-8c50-84d9354bdc67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb539e1e781a4dd998878d3c65ce37a7'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:29.739119 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-67ee0869-b520-4e0f-8c50-84d9354bdc67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb539e1e781a4dd998878d3c65ce37a7'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:29.739807 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-67ee0869-b520-4e0f-8c50-84d9354bdc67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb539e1e781a4dd998878d3c65ce37a7'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:29.763614 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-67ee0869-b520-4e0f-8c50-84d9354bdc67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb539e1e781a4dd998878d3c65ce37a7'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:29.777903 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-67ee0869-b520-4e0f-8c50-84d9354bdc67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb539e1e781a4dd998878d3c65ce37a7'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:29.789381 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:34:29.801324 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 625/1250] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Jul 26 10:34:29 2022] DELETE /identity/v3/users/eb539e1e781a4dd998878d3c65ce37a7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:34:30.016677 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc47a3-6d2d-43e1-a715-306d121bff3b service placement] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:30.029620 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc47a3-6d2d-43e1-a715-306d121bff3b service placement] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:30.101316 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:30.101972 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:30.102271 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:30.102540 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] PATH_INFO: `/v3/projects/5773f10f8fb74cd7a3dd2d08398256a3` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:30.103730 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5773f10f8fb74cd7a3dd2d08398256a3)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:30.104758 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: WARNING py.warnings [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:34:30.104758 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: warnings.warn(msg) Jul 26 10:34:30.104758 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: Jul 26 10:34:30.105949 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:30.170063 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5773f10f8fb74cd7a3dd2d08398256a3', 'request_id': 'req-bd0d5691-ab0c-4561-b18b-f6335a959285'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:30.177688 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5773f10f8fb74cd7a3dd2d08398256a3', 'request_id': 'req-bd0d5691-ab0c-4561-b18b-f6335a959285'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:30.187522 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5773f10f8fb74cd7a3dd2d08398256a3', 'request_id': 'req-bd0d5691-ab0c-4561-b18b-f6335a959285'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:30.224273 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] The token cache is being invalidate because project 5773f10f8fb74cd7a3dd2d08398256a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 10:34:30.224561 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:30.225264 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:30.226895 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 626/1251] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Jul 26 10:34:30 2022] DELETE /identity/v3/projects/5773f10f8fb74cd7a3dd2d08398256a3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:34:30.231257 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee0869-b520-4e0f-8c50-84d9354bdc67 admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:30.232781 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-67ee0869-b520-4e0f-8c50-84d9354bdc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:34:30.246734 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee0869-b520-4e0f-8c50-84d9354bdc67 admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:30.316319 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab9917-cf36-42b7-9e1a-9c5ca5978ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:30.316873 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab9917-cf36-42b7-9e1a-9c5ca5978ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:30.317147 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab9917-cf36-42b7-9e1a-9c5ca5978ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:30.317416 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab9917-cf36-42b7-9e1a-9c5ca5978ae0 admin admin] PATH_INFO: `/v3/users/87e34456c99047fe9a0585cd2fc69901` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:30.318633 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab9917-cf36-42b7-9e1a-9c5ca5978ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e34456c99047fe9a0585cd2fc69901)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:30.320557 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab9917-cf36-42b7-9e1a-9c5ca5978ae0 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:30.372038 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-c1ab9917-cf36-42b7-9e1a-9c5ca5978ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e34456c99047fe9a0585cd2fc69901'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:30.372690 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-c1ab9917-cf36-42b7-9e1a-9c5ca5978ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e34456c99047fe9a0585cd2fc69901'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:30.373315 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-c1ab9917-cf36-42b7-9e1a-9c5ca5978ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e34456c99047fe9a0585cd2fc69901'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:30.385835 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-c1ab9917-cf36-42b7-9e1a-9c5ca5978ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e34456c99047fe9a0585cd2fc69901'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:30.393609 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-c1ab9917-cf36-42b7-9e1a-9c5ca5978ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e34456c99047fe9a0585cd2fc69901'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:30.407433 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 626/1252] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Jul 26 10:34:30 2022] DELETE /identity/v3/users/87e34456c99047fe9a0585cd2fc69901 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:34:30.598040 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:30.599664 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:34:30.614917 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d5691-ab0c-4561-b18b-f6335a959285 admin admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:30.690666 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e9fd4-1919-4b92-865c-c4275c4f7cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:30.691331 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e9fd4-1919-4b92-865c-c4275c4f7cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:30.691592 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e9fd4-1919-4b92-865c-c4275c4f7cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:30.691862 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e9fd4-1919-4b92-865c-c4275c4f7cf5 admin admin] PATH_INFO: `/v3/projects/daeea881f8c74182b87a66826b0b29bb` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:30.693069 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e9fd4-1919-4b92-865c-c4275c4f7cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daeea881f8c74182b87a66826b0b29bb)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:30.695013 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e9fd4-1919-4b92-865c-c4275c4f7cf5 admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:30.703501 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:34:30.754480 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-344e9fd4-1919-4b92-865c-c4275c4f7cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daeea881f8c74182b87a66826b0b29bb', 'request_id': 'req-344e9fd4-1919-4b92-865c-c4275c4f7cf5'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:30.760952 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-344e9fd4-1919-4b92-865c-c4275c4f7cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daeea881f8c74182b87a66826b0b29bb', 'request_id': 'req-344e9fd4-1919-4b92-865c-c4275c4f7cf5'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:30.770669 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-344e9fd4-1919-4b92-865c-c4275c4f7cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daeea881f8c74182b87a66826b0b29bb', 'request_id': 'req-344e9fd4-1919-4b92-865c-c4275c4f7cf5'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:30.782395 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-344e9fd4-1919-4b92-865c-c4275c4f7cf5 admin admin] The token cache is being invalidate because project daeea881f8c74182b87a66826b0b29bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 10:34:30.782710 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-344e9fd4-1919-4b92-865c-c4275c4f7cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:30.783416 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-344e9fd4-1919-4b92-865c-c4275c4f7cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:30.785134 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 627/1253] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Jul 26 10:34:30 2022] DELETE /identity/v3/projects/daeea881f8c74182b87a66826b0b29bb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:34:34.205805 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab9917-cf36-42b7-9e1a-9c5ca5978ae0 admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:34.207514 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-c1ab9917-cf36-42b7-9e1a-9c5ca5978ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:34:34.294144 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab9917-cf36-42b7-9e1a-9c5ca5978ae0 admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:34.317000 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:34:34.380183 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e98dd4-1808-4a94-ae64-9c2833965256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68b323bc2b54984ad2ed0d248675624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:34.380981 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98dd4-1808-4a94-ae64-9c2833965256 service nova] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:34.381324 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98dd4-1808-4a94-ae64-9c2833965256 service nova] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:34.381695 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98dd4-1808-4a94-ae64-9c2833965256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:34.383704 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-34e98dd4-1808-4a94-ae64-9c2833965256 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:34:34.397916 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e98dd4-1808-4a94-ae64-9c2833965256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:34.400012 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e98dd4-1808-4a94-ae64-9c2833965256 service nova] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:34.411399 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 627/1254] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:34:34 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:34:40.779171 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:34:44.406900 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=23 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:35:16.584631 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e9fd4-1919-4b92-865c-c4275c4f7cf5 admin admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:35:16.586081 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-344e9fd4-1919-4b92-865c-c4275c4f7cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:35:16.647231 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e9fd4-1919-4b92-865c-c4275c4f7cf5 admin admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:35:16.651526 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aa603-294a-4188-959f-221991699d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ed2d73e1984404b8099b18a9bb7594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:35:16.652157 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aa603-294a-4188-959f-221991699d9c service neutron] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:35:16.652419 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aa603-294a-4188-959f-221991699d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:35:16.652689 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aa603-294a-4188-959f-221991699d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:35:16.654773 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-288aa603-294a-4188-959f-221991699d9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:35:16.738398 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aa603-294a-4188-959f-221991699d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:35:16.739910 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aa603-294a-4188-959f-221991699d9c service neutron] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:35:16.749946 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 628/1255] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:35:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:35:23.141303 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f070bf-f91c-4fac-b33e-7109a996fc8b None None] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:35:23.141873 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f070bf-f91c-4fac-b33e-7109a996fc8b None None] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:35:23.141972 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f070bf-f91c-4fac-b33e-7109a996fc8b None None] PATH_INFO: `/` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:35:23.143862 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 628/1256] 10.222.0.60 () {54 vars in 921 bytes} [Tue Jul 26 10:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:35:23.155328 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f3a42-d937-49f5-b4fe-60990da23725 None None] REQUEST_METHOD: `POST` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:35:23.155900 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f3a42-d937-49f5-b4fe-60990da23725 None None] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:35:23.155900 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f3a42-d937-49f5-b4fe-60990da23725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:35:23.176064 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.auth.core [None req-8b9f3a42-d937-49f5-b4fe-60990da23725 None None] MFA Rules not processed for user `32a61a4fe5c74444af1afdbeaf9be512`. Rule list: `[]` (Enabled: `True`). {{(pid=87125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:35:23.177321 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-8b9f3a42-d937-49f5-b4fe-60990da23725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:35:23.214059 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f070bf-f91c-4fac-b33e-7109a996fc8b None None] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:35:23.215955 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-16f070bf-f91c-4fac-b33e-7109a996fc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:35:23.238214 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f070bf-f91c-4fac-b33e-7109a996fc8b None None] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:35:23.243173 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e65083-29fa-4ded-9222-b4651562288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:35:23.243855 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e65083-29fa-4ded-9222-b4651562288b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:35:23.244151 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e65083-29fa-4ded-9222-b4651562288b admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:35:23.244408 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e65083-29fa-4ded-9222-b4651562288b admin admin] PATH_INFO: `/v3/users/21d4b60c39614760b28eadcb4d2a3fe0` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:35:23.252378 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 629/1257] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Jul 26 10:35:23 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:35:23.259714 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e65083-29fa-4ded-9222-b4651562288b admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d4b60c39614760b28eadcb4d2a3fe0)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:35:23.261665 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e65083-29fa-4ded-9222-b4651562288b admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:35:23.263902 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f3a42-d937-49f5-b4fe-60990da23725 None None] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:35:23.265404 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-8b9f3a42-d937-49f5-b4fe-60990da23725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:35:23.278009 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f3a42-d937-49f5-b4fe-60990da23725 None None] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:35:23.284313 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2f70a-202e-496c-bdda-a09b7e8c22a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a61a4fe5c74444af1afdbeaf9be512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:35:23.284990 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2f70a-202e-496c-bdda-a09b7e8c22a6 service placement] REQUEST_METHOD: `GET` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:35:23.285320 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2f70a-202e-496c-bdda-a09b7e8c22a6 service placement] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:35:23.285613 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2f70a-202e-496c-bdda-a09b7e8c22a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:35:23.295619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2f70a-202e-496c-bdda-a09b7e8c22a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:35:23.297307 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2f70a-202e-496c-bdda-a09b7e8c22a6 service placement] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:35:23.307619 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 630/1258] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:35:23 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:35:23.309501 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-e8e65083-29fa-4ded-9222-b4651562288b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d4b60c39614760b28eadcb4d2a3fe0'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:23.310170 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-e8e65083-29fa-4ded-9222-b4651562288b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d4b60c39614760b28eadcb4d2a3fe0'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:23.310869 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-e8e65083-29fa-4ded-9222-b4651562288b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d4b60c39614760b28eadcb4d2a3fe0'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:23.323135 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-e8e65083-29fa-4ded-9222-b4651562288b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d4b60c39614760b28eadcb4d2a3fe0'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:23.330054 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-e8e65083-29fa-4ded-9222-b4651562288b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d4b60c39614760b28eadcb4d2a3fe0'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:23.344340 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 629/1259] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Jul 26 10:35:23 2022] DELETE /identity/v3/users/21d4b60c39614760b28eadcb4d2a3fe0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:35:23.555980 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2f70a-202e-496c-bdda-a09b7e8c22a6 service placement] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:35:23.567780 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2f70a-202e-496c-bdda-a09b7e8c22a6 service placement] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:35:23.604737 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=100 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:35:23.633660 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fddd0-7c5a-4175-985b-a59daeba6b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:35:23.634243 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fddd0-7c5a-4175-985b-a59daeba6b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:35:23.634564 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fddd0-7c5a-4175-985b-a59daeba6b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:35:23.634828 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fddd0-7c5a-4175-985b-a59daeba6b22 admin admin] PATH_INFO: `/v3/projects/d7eb7bb935af41458c5be5a6eee53325` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:35:23.645680 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fddd0-7c5a-4175-985b-a59daeba6b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7eb7bb935af41458c5be5a6eee53325)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:35:23.647630 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fddd0-7c5a-4175-985b-a59daeba6b22 admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:35:23.695606 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-8a2fddd0-7c5a-4175-985b-a59daeba6b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7eb7bb935af41458c5be5a6eee53325', 'request_id': 'req-8a2fddd0-7c5a-4175-985b-a59daeba6b22'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:23.701557 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-8a2fddd0-7c5a-4175-985b-a59daeba6b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7eb7bb935af41458c5be5a6eee53325', 'request_id': 'req-8a2fddd0-7c5a-4175-985b-a59daeba6b22'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:23.711985 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-8a2fddd0-7c5a-4175-985b-a59daeba6b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7eb7bb935af41458c5be5a6eee53325', 'request_id': 'req-8a2fddd0-7c5a-4175-985b-a59daeba6b22'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:23.728900 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-8a2fddd0-7c5a-4175-985b-a59daeba6b22 admin admin] The token cache is being invalidate because project d7eb7bb935af41458c5be5a6eee53325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 10:35:23.729237 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-8a2fddd0-7c5a-4175-985b-a59daeba6b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:23.730024 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-8a2fddd0-7c5a-4175-985b-a59daeba6b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:23.732317 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 631/1260] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Jul 26 10:35:23 2022] DELETE /identity/v3/projects/d7eb7bb935af41458c5be5a6eee53325 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:35:23.736816 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e65083-29fa-4ded-9222-b4651562288b admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:35:23.738370 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-e8e65083-29fa-4ded-9222-b4651562288b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:35:23.753907 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e65083-29fa-4ded-9222-b4651562288b admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:35:23.814957 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417d8d7-3877-44ce-941c-4e8a5ef73577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:35:23.815591 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417d8d7-3877-44ce-941c-4e8a5ef73577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:35:23.815874 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417d8d7-3877-44ce-941c-4e8a5ef73577 admin admin] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:35:23.816145 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417d8d7-3877-44ce-941c-4e8a5ef73577 admin admin] PATH_INFO: `/v3/users/d4d8cac7a51f402686d23967e030ae48` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:35:23.830126 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417d8d7-3877-44ce-941c-4e8a5ef73577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d8cac7a51f402686d23967e030ae48)` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:35:23.832119 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417d8d7-3877-44ce-941c-4e8a5ef73577 admin admin] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:35:23.887183 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-2417d8d7-3877-44ce-941c-4e8a5ef73577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d8cac7a51f402686d23967e030ae48'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:23.887915 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-2417d8d7-3877-44ce-941c-4e8a5ef73577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d8cac7a51f402686d23967e030ae48'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:23.889418 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-2417d8d7-3877-44ce-941c-4e8a5ef73577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d8cac7a51f402686d23967e030ae48'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:23.894147 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:35:23.903629 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-2417d8d7-3877-44ce-941c-4e8a5ef73577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d8cac7a51f402686d23967e030ae48'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:23.910884 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.notifications [None req-2417d8d7-3877-44ce-941c-4e8a5ef73577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d8cac7a51f402686d23967e030ae48'} {{(pid=87124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:23.926041 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 630/1261] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Jul 26 10:35:23 2022] DELETE /identity/v3/users/d4d8cac7a51f402686d23967e030ae48 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:35:24.111332 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fddd0-7c5a-4175-985b-a59daeba6b22 admin admin] Authenticating user token {{(pid=87125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:35:24.113081 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.fernet_utils [None req-8a2fddd0-7c5a-4175-985b-a59daeba6b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:35:24.128409 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fddd0-7c5a-4175-985b-a59daeba6b22 admin admin] Validating token access rules against request {{(pid=87125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:35:24.186560 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4221e-768c-4edb-b368-efec2d31494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7aff02dbe9d4c34ad6d286018218135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a699385ce385472fabea3d65e4ca80c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:35:24.187213 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4221e-768c-4edb-b368-efec2d31494b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:35:24.187416 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4221e-768c-4edb-b368-efec2d31494b admin admin] SCRIPT_NAME: `/identity` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:35:24.187682 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4221e-768c-4edb-b368-efec2d31494b admin admin] PATH_INFO: `/v3/projects/ed02b5fa87bf42b0b8b0dba7882df54d` {{(pid=87125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:35:24.198160 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4221e-768c-4edb-b368-efec2d31494b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed02b5fa87bf42b0b8b0dba7882df54d)` {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:35:24.200112 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4221e-768c-4edb-b368-efec2d31494b admin admin] RBAC: Authorization granted {{(pid=87125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:35:24.248984 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:35:24.250179 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-9df4221e-768c-4edb-b368-efec2d31494b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed02b5fa87bf42b0b8b0dba7882df54d', 'request_id': 'req-9df4221e-768c-4edb-b368-efec2d31494b'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:24.257451 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-9df4221e-768c-4edb-b368-efec2d31494b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed02b5fa87bf42b0b8b0dba7882df54d', 'request_id': 'req-9df4221e-768c-4edb-b368-efec2d31494b'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:24.265101 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-9df4221e-768c-4edb-b368-efec2d31494b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed02b5fa87bf42b0b8b0dba7882df54d', 'request_id': 'req-9df4221e-768c-4edb-b368-efec2d31494b'} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:24.276785 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-9df4221e-768c-4edb-b368-efec2d31494b admin admin] The token cache is being invalidate because project ed02b5fa87bf42b0b8b0dba7882df54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 10:35:24.276980 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-9df4221e-768c-4edb-b368-efec2d31494b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:24.277655 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG keystone.notifications [None req-9df4221e-768c-4edb-b368-efec2d31494b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:35:24.279302 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: [pid: 87125|app: 0|req: 632/1262] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Jul 26 10:35:24 2022] DELETE /identity/v3/projects/ed02b5fa87bf42b0b8b0dba7882df54d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 10:35:33.922085 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:DELETE=3,keystone:SELECT=10,keystone:INSERT=1 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:35:34.273763 dv-osbrick-850937-2-ceph devstack@keystone.service[87125]: DEBUG dbcounter [-] [87125] Writing DB stats keystone:SELECT=7,keystone:DELETE=3,keystone:INSERT=1 {{(pid=87125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:38:46.453336 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417d8d7-3877-44ce-941c-4e8a5ef73577 admin admin] Authenticating user token {{(pid=87124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:38:46.454943 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-2417d8d7-3877-44ce-941c-4e8a5ef73577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:38:46.536792 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417d8d7-3877-44ce-941c-4e8a5ef73577 admin admin] Validating token access rules against request {{(pid=87124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:38:46.620221 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08913a99-6288-4626-b0fd-9544b69c51a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a61a4fe5c74444af1afdbeaf9be512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6897068dc29445f7878c7c12a0915d48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:38:46.621025 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08913a99-6288-4626-b0fd-9544b69c51a7 service placement] REQUEST_METHOD: `GET` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:38:46.621309 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08913a99-6288-4626-b0fd-9544b69c51a7 service placement] SCRIPT_NAME: `/identity` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:38:46.621580 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08913a99-6288-4626-b0fd-9544b69c51a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:38:46.624571 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.fernet_utils [None req-08913a99-6288-4626-b0fd-9544b69c51a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:38:46.641995 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08913a99-6288-4626-b0fd-9544b69c51a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:38:46.644352 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08913a99-6288-4626-b0fd-9544b69c51a7 service placement] RBAC: Authorization granted {{(pid=87124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:38:46.654979 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: [pid: 87124|app: 0|req: 631/1263] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Jul 26 10:38:46 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:38:56.650716 dv-osbrick-850937-2-ceph devstack@keystone.service[87124]: DEBUG dbcounter [-] [87124] Writing DB stats keystone:SELECT=62 {{(pid=87124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}